-- Logs begin at Wed 2022-06-15 23:40:13 UTC, end at Thu 2022-06-16 00:58:41 UTC. -- Jun 16 00:25:59.346356 dv-cinder-803823-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:25:59.355261 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:25:59 2022] *** Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: nodename: dv-cinder-803823-11-iscsi Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: machine: x86_64 Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: clock source: unix Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: pcre jit disabled Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: detected number of CPU cores: 4 Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: current working directory: / Jun 16 00:25:59.357421 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: your processes number limit is 47680 Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: your memory page size is 4096 bytes Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: detected max file descriptor number: 2048 Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: lock engine: pthread robust mutexes Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: thunder lock: enabled Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:25:59.358125 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:25:59.402355 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: Python main interpreter initialized at 0x55576fe879c0 Jun 16 00:25:59.402355 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: python threads support enabled Jun 16 00:25:59.402355 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: your server socket listen backlog is limited to 100 connections Jun 16 00:25:59.402355 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:25:59.402758 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:25:59.402835 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: *** Operational MODE: preforking *** Jun 16 00:25:59.403052 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:25:59.403052 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: spawned uWSGI master process (pid: 110282) Jun 16 00:25:59.403246 dv-cinder-803823-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:25:59.404756 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: spawned uWSGI worker 1 (pid: 110283, cores: 1) Jun 16 00:25:59.404756 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: spawned uWSGI worker 2 (pid: 110284, cores: 1) Jun 16 00:25:59.404756 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:26:00.075099 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:26:00.083748 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:26:01.254146 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:01.254146 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: from cryptography.utils import int_from_bytes Jun 16 00:26:01.254776 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:01.254776 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: from cryptography.utils import int_from_bytes Jun 16 00:26:01.257984 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:01.257984 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: from cryptography.utils import int_from_bytes Jun 16 00:26:01.258411 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:26:01.258411 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: from cryptography.utils import int_from_bytes Jun 16 00:26:03.852872 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:26:03.853399 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:26:03.853550 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:26:03.853907 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:26:03.854160 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:26:03.854542 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.854864 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.855179 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.855492 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.855820 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.856125 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.856441 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.856788 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.857111 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.857369 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.857679 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.858000 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-11-iscsi {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.858318 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.858620 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.858924 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.859236 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.859473 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:26:03.859856 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.859947 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:26:03.860027 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.860112 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.860238 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:26:03.860626 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.860744 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:26:03.860881 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:26:03.861062 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.861268 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.861390 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.861595 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.861710 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.861920 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862045 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862240 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862369 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862561 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862695 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.862870 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863003 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863170 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863312 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863487 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863621 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863790 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.863917 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864049 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864181 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-11-iscsi {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864362 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864496 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864719 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-11-iscsi {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.864859 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865051 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865178 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865358 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865485 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865699 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.865827 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866018 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866152 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866327 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866477 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866653 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866785 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.866957 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867061 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867463 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867604 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867774 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.867918 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868079 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868231 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868386 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868547 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868749 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.868872 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869064 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869161 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869385 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869472 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869692 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.869783 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870001 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870095 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870248 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870337 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870543 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870635 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.870859 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871001 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-11-iscsi {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871174 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871315 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871494 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871627 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871744 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.871939 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872043 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872288 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872384 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872635 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872727 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.872938 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873025 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873240 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873328 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873542 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873629 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873841 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.873941 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874142 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874235 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874441 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874534 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874740 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.874840 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875039 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875132 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875353 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875446 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875664 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.875978 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876074 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876279 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876365 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876618 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876793 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.876923 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877013 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877158 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877245 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877467 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877556 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877792 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.877896 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878115 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878202 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878445 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878534 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878684 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878779 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.878935 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879029 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879254 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879365 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879578 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879665 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.879888 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880001 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880196 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880283 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880503 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880612 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880828 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.880925 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.881074 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.881663 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.881904 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882092 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882207 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882406 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882522 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882718 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.882824 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883041 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883138 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883362 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883450 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883688 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883780 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.883987 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884083 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884286 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884373 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884615 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884705 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.884917 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885020 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885216 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885304 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885513 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885606 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885809 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.885905 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886105 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886204 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886402 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886489 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886715 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.886815 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887026 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887117 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887325 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887413 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887621 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887717 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.887917 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888020 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888214 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888302 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888559 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888651 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888853 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.888939 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889151 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889282 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889457 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889547 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889754 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.889839 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890050 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890136 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890358 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890453 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890657 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890743 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.890955 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891051 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891264 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891352 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891555 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891651 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891854 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.891950 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892157 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892250 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892455 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892577 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892779 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.892880 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893076 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893171 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893373 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893470 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893670 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893767 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.893967 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894062 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894261 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894347 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894554 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894653 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894845 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.894932 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895140 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895233 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895452 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895549 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895753 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.895848 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896050 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896137 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896346 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896441 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896679 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.896783 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.897556 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.897709 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.897853 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.897951 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.898174 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.898261 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.898485 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.898578 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.898793 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.898883 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.899112 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.899198 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.899413 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.899499 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.899718 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.899805 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.900027 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.900113 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.900334 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.900419 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.900660 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.900752 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.900965 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.901061 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.901267 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.901366 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.901568 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.901654 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.901872 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.901966 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.902175 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.902271 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.902478 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.902566 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.902777 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.902863 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.903083 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.903251 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.903383 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.903476 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.903691 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.903779 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.903992 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.904087 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.904298 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.904384 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.904625 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.904714 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:26:03.904964 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905065 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905301 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905394 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905610 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905722 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.905930 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906032 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906243 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906332 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906549 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906635 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906854 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.906943 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907159 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907248 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907475 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907563 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907801 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.907908 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908101 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908195 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908410 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908497 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908738 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.908830 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909041 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909138 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909346 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909469 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909650 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909738 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.909952 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910039 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910277 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910377 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910585 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910672 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910893 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.910986 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911197 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911294 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911509 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911596 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911812 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.911908 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912121 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912218 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912444 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912577 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912773 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.912863 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913073 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913182 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913371 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913458 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913674 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913763 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.913970 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914069 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914281 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914380 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914603 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914698 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914904 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.914992 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915228 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915316 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915526 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915614 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915829 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.915924 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916132 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916219 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916432 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916536 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916757 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.916857 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917063 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917151 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917365 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917454 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917662 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917806 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.917983 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918098 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918290 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918399 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918587 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918682 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918902 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.918990 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919201 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919297 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919502 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919589 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919810 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.919898 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920111 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920210 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920412 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920497 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920738 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.920827 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921140 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921339 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921425 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921647 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921733 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.921957 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922046 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922266 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922352 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922595 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922682 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922894 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.922984 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923201 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923287 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923510 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923597 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923819 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.923913 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924118 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924217 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924422 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924509 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924748 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.924838 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925047 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925136 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925345 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925511 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925647 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925735 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.925944 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926041 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926243 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926339 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926542 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926637 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926841 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.926935 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927139 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927236 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927626 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927761 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927761 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.927963 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.928167 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.928336 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.928426 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.928669 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.928760 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929008 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929109 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929308 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929404 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929622 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929717 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.929957 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930052 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930270 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930366 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930578 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930665 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930882 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.930977 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.931435 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.931529 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.931750 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.931837 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932062 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932158 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932371 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932461 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932699 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.932786 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933007 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933094 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933310 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933414 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933617 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933718 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.933919 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934007 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934223 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934309 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934532 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934619 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934838 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.934927 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935134 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935220 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935442 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935529 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935762 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.935848 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936070 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936157 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936379 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936475 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936737 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.936834 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937044 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937138 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937355 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937451 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937662 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937750 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.937968 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938102 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938276 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938399 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938585 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938693 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938898 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.938986 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939204 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939301 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939517 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939605 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939820 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.939908 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940138 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940235 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940442 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940549 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940793 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.940883 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941096 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941193 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941405 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941493 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941718 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.941814 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942049 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942138 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942354 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942442 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942662 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942757 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.942965 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.943053 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.943273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.943360 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.943579 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.944185 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.944419 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.944509 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.944749 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.944848 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945050 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945147 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945354 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945449 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945664 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945752 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.945969 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946066 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946272 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946360 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946571 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946658 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946881 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.946978 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947184 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947284 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947481 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947577 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947779 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.947875 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948082 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948210 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948401 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948501 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948731 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.948821 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949047 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949134 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949363 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949450 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949663 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949752 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.949962 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950052 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950278 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950366 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950581 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950669 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950878 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.950966 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951176 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951264 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951470 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951572 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951808 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.951895 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952115 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952210 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952415 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952512 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952745 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.952844 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953059 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953155 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953363 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953450 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953669 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953758 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.953973 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954069 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954275 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954368 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954589 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954676 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.954894 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955063 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955199 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955284 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955502 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955588 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955805 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.955901 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956110 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956197 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956413 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956500 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956753 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.956842 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957055 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957142 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957359 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957453 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957661 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957749 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.957956 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958041 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958258 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958397 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958586 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958672 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.958858 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.959118 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.959206 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960022 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960132 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960332 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960420 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960669 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960800 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.960989 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961077 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961300 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961387 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961611 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961705 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.961929 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962024 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962243 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962337 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962555 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962652 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962856 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.962951 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963157 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963251 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963455 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963542 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963759 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.963860 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964059 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964147 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964357 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964445 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964690 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964798 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.964995 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965084 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965293 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965379 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965592 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965681 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965891 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.965988 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966189 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966277 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966497 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966585 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966792 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.966878 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967095 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967367 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967464 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967696 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967782 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.967998 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968095 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968294 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968435 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968614 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968706 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.968913 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969002 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969249 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969338 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969547 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969634 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969877 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.969963 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970201 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970299 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970513 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970601 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970822 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.970910 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971116 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971211 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971426 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971512 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971721 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.971807 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972020 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972153 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972317 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972404 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972646 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972738 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.972948 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973048 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973243 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973339 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973546 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973632 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973844 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.973939 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974145 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974234 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974446 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974532 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974739 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.974835 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975063 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975160 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975361 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975450 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975666 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975796 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.975966 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976054 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976261 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976349 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976580 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976671 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976886 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.976973 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977184 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977271 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977479 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977570 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977779 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.977868 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978072 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978192 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978380 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978505 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978680 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978794 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.978976 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979137 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979272 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979412 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979575 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979719 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.979875 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980025 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980169 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980336 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980486 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980668 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980814 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.980973 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981111 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981284 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981407 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981595 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981691 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981906 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.981993 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982214 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982302 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982518 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982619 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982827 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.982914 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983131 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983226 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983435 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983534 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983737 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.983826 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984120 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984327 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984416 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984647 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984748 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.984949 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985037 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985244 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985332 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985541 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985636 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985837 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.985933 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986131 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986220 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986426 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986513 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986738 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.986824 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987037 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987125 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987333 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987421 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987629 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987726 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.987923 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988011 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988244 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988331 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988572 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988674 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988873 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.988960 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989178 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989483 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989621 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989783 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.989869 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.990085 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.990173 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.990386 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.990482 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991223 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991314 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991523 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991610 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991829 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.991930 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992132 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992221 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992433 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992550 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992754 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.992843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993057 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993151 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993366 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993454 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993670 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993757 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.993969 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994064 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994274 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994361 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994577 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994666 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994881 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.994975 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995175 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995269 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995476 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995564 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995778 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.995878 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996078 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996175 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996377 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996464 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996703 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.996793 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997006 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997106 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997311 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997398 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997611 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997705 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.997918 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998015 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998221 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998309 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998522 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998610 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998825 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.998929 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999125 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999212 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999420 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999508 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999737 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:03.999825 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000133 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000336 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000467 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000661 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000758 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.000957 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001050 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001261 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001348 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001558 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001647 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001867 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.001997 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002190 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002285 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002515 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002604 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002837 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.002923 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003137 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003232 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003438 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003524 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003746 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.003840 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004049 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004144 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004346 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004433 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004685 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004786 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.004999 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005096 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005309 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005396 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005621 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005708 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.005935 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.006036 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.006776 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.006873 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007094 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007181 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007405 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007494 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007713 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.007813 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008011 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008106 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008310 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008401 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008651 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008742 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.008955 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009045 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009261 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009348 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009564 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009661 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009873 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.009961 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.010178 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.010267 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.010604 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.010698 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.010917 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011014 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011218 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011305 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011523 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011610 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011834 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.011929 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012144 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012233 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012439 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012604 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012774 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.012873 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013077 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013164 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013395 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013482 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013712 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.013809 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014016 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014105 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014324 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014411 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014712 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.014940 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015029 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015258 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015347 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015565 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015654 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015873 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.015958 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016178 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016266 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016483 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016631 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016840 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.016938 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017148 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017237 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017472 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017561 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017786 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.017882 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018085 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018174 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018389 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018485 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018690 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018881 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.018991 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019194 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019308 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019506 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019603 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019831 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.019927 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020155 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020243 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020475 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020582 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020799 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.020896 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021097 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021194 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021410 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021498 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021705 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.021832 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022048 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022183 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022356 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022446 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022671 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022760 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.022974 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023069 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023280 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023368 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023597 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023685 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023897 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.023993 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024195 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024283 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024492 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024635 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024812 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.024951 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025147 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025260 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025444 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025583 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025755 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.025912 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026078 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026220 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026399 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026526 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026704 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.026843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027031 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027150 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027349 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027441 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027660 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027749 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.027968 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028056 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028285 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028379 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028616 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028713 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.028916 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029043 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029221 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029311 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029519 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029608 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029815 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.029903 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030110 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030207 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030410 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030499 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030705 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.030800 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031002 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031100 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031298 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031386 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031611 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031706 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.031907 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032004 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032221 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032310 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032551 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032698 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032839 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.032937 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033141 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033239 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033437 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033525 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033769 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.033857 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034064 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034152 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034387 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034475 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034694 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.034784 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035011 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035098 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035330 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035434 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035631 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035721 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.035949 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036043 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036260 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036349 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036597 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036701 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036906 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.036994 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037209 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037306 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037540 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037629 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037845 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.037938 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038149 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038246 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038448 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038536 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038753 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.038847 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039055 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039198 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039361 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039450 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039665 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039872 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.039988 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040192 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040281 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040501 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040616 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040830 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.040930 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041137 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041226 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041445 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041540 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041752 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.041849 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042057 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042145 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042360 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042447 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042663 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042760 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.042966 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043054 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043289 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043384 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043606 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043704 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.043927 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044022 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044252 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044340 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044578 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044670 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044890 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.044995 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045198 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045286 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045505 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045594 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045816 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.045904 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046134 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046239 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046435 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046531 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046743 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.046832 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047051 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047213 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047358 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047447 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047660 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047749 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.047963 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048177 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048275 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048507 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048632 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048850 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.048939 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049161 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049294 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049465 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049554 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049770 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.049868 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050080 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050167 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050392 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050487 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050703 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.050800 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051010 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051104 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051311 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051397 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051618 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051715 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.051946 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052129 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052274 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052440 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052635 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052791 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.052956 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.053634 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.053795 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.053957 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054108 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054266 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054425 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054578 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054782 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.054900 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055099 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055192 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055409 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055497 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055722 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.055824 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.056036 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.056125 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.056623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.056715 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.056937 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057040 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057240 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057327 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057540 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057628 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057852 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.057952 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.058151 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.058238 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.058458 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.058678 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.058775 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059016 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059106 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059329 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059420 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059651 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059748 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.059972 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060060 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060283 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060371 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060608 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060709 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.060929 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061061 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061229 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061448 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061545 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061766 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.061854 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062101 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062189 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062399 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062494 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062698 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.062794 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063001 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063089 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063302 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063403 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063605 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063694 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063909 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.063996 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064205 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064306 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064553 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064645 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064847 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.064934 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065143 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065242 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065441 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065531 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065744 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.065839 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066042 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066130 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066338 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066425 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066636 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066733 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.066935 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067178 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067279 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067520 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067606 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067820 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.067917 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.068118 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.068213 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.068422 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.068510 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.069290 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.069391 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.069600 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.069688 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.069938 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070028 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070257 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070344 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070554 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070647 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070852 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.070949 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071161 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071271 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071462 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071549 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071768 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.071869 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072068 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072157 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072371 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072459 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072698 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.072801 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073012 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073101 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073319 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073546 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073633 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073874 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.073972 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074188 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074276 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074514 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074602 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074821 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.074909 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075125 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075231 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075419 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075506 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075715 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.075808 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076016 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076105 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076323 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076418 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076646 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076736 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.076954 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077051 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077258 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077423 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077561 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077691 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077862 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.077957 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078162 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078259 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078464 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078560 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078766 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.078857 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079068 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079157 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079367 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079463 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079667 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079755 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.079968 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080057 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080362 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080615 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080717 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.080928 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081016 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081242 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081355 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081552 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081653 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.081858 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082095 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082183 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082433 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082528 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082735 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.082824 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083034 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083120 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083339 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083427 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083667 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083758 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.083971 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084058 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084270 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084378 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084646 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084738 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.084950 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085053 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085263 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085366 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085575 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085663 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085887 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.085975 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086198 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086296 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086510 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086598 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086814 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.086901 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087121 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087217 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087422 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087508 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087735 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.087821 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088046 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088141 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088355 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088442 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088689 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088779 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.088987 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089084 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089286 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089374 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089583 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089670 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089885 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.089974 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090196 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090283 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090498 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090592 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090794 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.090884 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091090 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091176 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091390 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091499 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091683 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.091979 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092067 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092275 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092381 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092588 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092680 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092890 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.092978 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093186 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093349 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093484 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093663 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093781 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.093983 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094080 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094305 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094393 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094616 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094704 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.094923 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095023 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095218 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095313 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095513 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095609 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095806 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.095903 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096198 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096392 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096488 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096738 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.096841 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097063 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097152 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097370 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097458 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097685 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097774 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.097985 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098076 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098298 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098393 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098601 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098690 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.098916 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099003 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099226 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099320 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099527 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099615 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099824 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.099930 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100155 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100251 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100460 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100568 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100789 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.100877 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101090 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101190 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101400 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101538 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101690 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101779 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.101988 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102085 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102293 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102597 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102685 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.102937 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103044 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103197 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103285 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103498 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103585 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103805 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.103894 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104108 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104195 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104410 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104497 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104733 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.104825 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105038 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105125 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105340 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105427 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105647 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105737 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.105951 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106049 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106256 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106353 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106564 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106653 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106874 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.106984 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107196 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107297 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107505 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107600 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107806 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.107893 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108125 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108222 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108435 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108572 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108766 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.108855 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109092 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109193 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109399 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109486 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109710 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.109797 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110021 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110110 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110327 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110421 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110627 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110724 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.110866 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:26:04.110956 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.111246 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.111574 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.111880 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.112207 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.112557 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.112873 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.113190 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.113503 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.113836 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.114147 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.114456 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.114774 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.115084 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.115395 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.116246 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.116595 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.116932 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.117263 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.117577 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.117912 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.118239 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.118591 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.118909 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.119256 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.119586 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.119905 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.120220 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.120566 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:26:04.120794 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:26:04.172264 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Registered counter for database nova_api Jun 16 00:26:04.182959 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Registered counter for database nova_api Jun 16 00:26:04.194625 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.201216 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.202715 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.209038 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.258181 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.context [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05a3bc2a-bfb9-434c-ae77-5f7d553f0730(cell1) {{(pid=110284) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:26:04.262268 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:04.263829 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:04.264658 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:04.266608 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:04.266736 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.context [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05a3bc2a-bfb9-434c-ae77-5f7d553f0730(cell1) {{(pid=110283) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:26:04.268551 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Registered counter for database nova_cell0 Jun 16 00:26:04.270709 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:04.272347 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:04.272446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Registered counter for database nova_cell1 Jun 16 00:26:04.273187 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:26:04.275183 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_concurrency.lockutils [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:26:04.277139 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Registered counter for database nova_cell0 Jun 16 00:26:04.280544 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.281037 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Registered counter for database nova_cell1 Jun 16 00:26:04.282728 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.288191 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.288329 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.290250 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.290934 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.297969 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.299261 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.435775 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO dbcounter [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Registered counter for database nova_cell0 Jun 16 00:26:04.444346 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_db.sqlalchemy.engines [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.447596 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO dbcounter [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Registered counter for database nova_cell0 Jun 16 00:26:04.448568 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writer thread running {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.456163 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG oslo_db.sqlalchemy.engines [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:26:04.460475 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writer thread running {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:26:04.852487 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:04.859792 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:04.882926 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:04.890084 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:05.198573 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:05.204594 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: WARNING keystonemiddleware.auth_token [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:05.210212 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576fe879c0 pid: 110284 (default app) Jun 16 00:26:05.212289 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:26:05.213502 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jun 16 00:26:05.213896 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Thu Jun 16 00:26:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:26:05.230804 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:26:05.236770 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: WARNING keystonemiddleware.auth_token [None req-4a3370e9-d5e8-456c-b240-b029a11ce6e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:26:05.242067 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576fe879c0 pid: 110283 (default app) Jun 16 00:27:23.387058 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:23.388061 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 16 00:27:23.388458 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:23.400545 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:23.401522 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell1:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:23.402573 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell0:SELECT=3 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:23.411479 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:23.851739 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8de8f3e6-272c-4609-8a89-be3362d4d658 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:23.881514 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8de8f3e6-272c-4609-8a89-be3362d4d658 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485301 Jun 16 00:27:23.887546 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jun 16 00:27:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:26.043439 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:26.044456 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-04f77894-432c-4322-83d0-401e370c12d1 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 16 00:27:26.053573 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:26.113222 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-886ae7ac-6408-4dc0-98b6-438f0c7992ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0, "disk": 1}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:26.136724 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:26.136724 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 00:27:26.268260 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-886ae7ac-6408-4dc0-98b6-438f0c7992ff admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.216495 Jun 16 00:27:26.269152 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:26.282293 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.283544 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell1:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.284147 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=3 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.285020 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.492330 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-b6fc63fd-c15c-49e1-84e4-2d0f5fe682b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:26.494830 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:26.494830 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:27:26.602508 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-b6fc63fd-c15c-49e1-84e4-2d0f5fe682b9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325357 Jun 16 00:27:26.603081 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jun 16 00:27:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:28.783839 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-886ae7ac-6408-4dc0-98b6-438f0c7992ff admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:28.784914 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-886ae7ac-6408-4dc0-98b6-438f0c7992ff admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 00:27:28.785475 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:28.896003 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c4e33db8-c6db-4e9c-ae27-fd1b17999814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:28.914375 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:28.914375 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:27:29.064622 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-c4e33db8-c6db-4e9c-ae27-fd1b17999814 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.273497 Jun 16 00:27:29.089818 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:29.090892 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-ad5c7160-d789-4153-ba2f-c427a8872b09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:29.090892 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:27:29.090892 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: warnings.warn(msg) Jun 16 00:27:29.415134 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-ad5c7160-d789-4153-ba2f-c427a8872b09 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341136 Jun 16 00:27:29.416031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jun 16 00:27:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:31.660451 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c4e33db8-c6db-4e9c-ae27-fd1b17999814 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:31.661516 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-c4e33db8-c6db-4e9c-ae27-fd1b17999814 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 16 00:27:31.662476 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:31.723193 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6cd1bf6f-6249-49fe-92b7-85bc91deb1d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:31.816094 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-6cd1bf6f-6249-49fe-92b7-85bc91deb1d5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147751 Jun 16 00:27:31.823856 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:31.829226 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-9e0a367e-6b1d-41c2-92a7-a6b424add3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:31.935828 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-9e0a367e-6b1d-41c2-92a7-a6b424add3e7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110603 Jun 16 00:27:31.936682 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jun 16 00:27:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:34.147794 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6cd1bf6f-6249-49fe-92b7-85bc91deb1d5 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:34.148835 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-6cd1bf6f-6249-49fe-92b7-85bc91deb1d5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 00:27:34.149237 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:34.209276 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0e05b17f-4892-4624-b12d-88daadb8d596 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "ram": 2048}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:34.277723 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0e05b17f-4892-4624-b12d-88daadb8d596 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.122600 Jun 16 00:27:34.278279 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:34.290382 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-b2474d53-39e3-4569-b87f-847af73285c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:34.361610 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-b2474d53-39e3-4569-b87f-847af73285c0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075143 Jun 16 00:27:34.362191 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jun 16 00:27:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:36.552002 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0e05b17f-4892-4624-b12d-88daadb8d596 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:36.553038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0e05b17f-4892-4624-b12d-88daadb8d596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 16 00:27:36.553432 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:36.621696 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "ram": 4096, "swap": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:36.698379 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138628 Jun 16 00:27:36.699462 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:36.711511 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-340c59ca-13a9-412d-92df-177c51cfec98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:36.783477 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-340c59ca-13a9-412d-92df-177c51cfec98 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076102 Jun 16 00:27:36.784056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Thu Jun 16 00:27:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:38.997076 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:38.998097 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 16 00:27:38.998671 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:39.058476 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-a43d6dcd-2aa9-438c-a428-b7c62c3f1fa2 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:39.081713 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-a43d6dcd-2aa9-438c-a428-b7c62c3f1fa2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076941 Jun 16 00:27:39.082449 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jun 16 00:27:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:27:41.294204 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:41.295211 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8e2ff0e0-8433-4632-91f1-65a5eb25c397 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 00:27:41.295629 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:41.357870 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-441a026c-d9f5-4a6c-b8d5-a50c8665e061 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "vcpus": 1, "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:41.435339 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-441a026c-d9f5-4a6c-b8d5-a50c8665e061 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.133852 Jun 16 00:27:41.435885 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:41.447948 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-3d07f2df-e3e0-4fd0-8767-1f7654d9dcd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:41.522473 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-3d07f2df-e3e0-4fd0-8767-1f7654d9dcd8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078245 Jun 16 00:27:41.523445 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jun 16 00:27:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:43.786146 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-441a026c-d9f5-4a6c-b8d5-a50c8665e061 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:43.787146 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-441a026c-d9f5-4a6c-b8d5-a50c8665e061 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 16 00:27:43.787548 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:43.848565 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-cf6e9393-804b-45c7-a0cd-c14056f1dd76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:43.920677 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-cf6e9393-804b-45c7-a0cd-c14056f1dd76 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126976 Jun 16 00:27:43.921253 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:27:43.933745 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-fe9385a3-a946-4d69-8def-d16bd2d5e309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:44.018700 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-fe9385a3-a946-4d69-8def-d16bd2d5e309 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088809 Jun 16 00:27:44.019282 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jun 16 00:27:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:46.472308 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-cf6e9393-804b-45c7-a0cd-c14056f1dd76 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:46.473353 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-cf6e9393-804b-45c7-a0cd-c14056f1dd76 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 16 00:27:46.473746 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:46.531351 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-efeb9990-24a1-4f23-927a-d0e0a734ebe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "swap": 0}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:46.611389 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-efeb9990-24a1-4f23-927a-d0e0a734ebe4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.131848 Jun 16 00:27:46.611938 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:27:46.623963 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-42c8a83e-347d-497d-a9ab-9060ada4fd43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:46.696227 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-42c8a83e-347d-497d-a9ab-9060ada4fd43 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075722 Jun 16 00:27:46.696758 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jun 16 00:27:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:27:48.900687 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-efeb9990-24a1-4f23-927a-d0e0a734ebe4 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:48.901687 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-efeb9990-24a1-4f23-927a-d0e0a734ebe4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 16 00:27:48.902074 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:27:48.970009 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-172359ec-9e4e-49af-9021-a8bee817e902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:49.036777 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-172359ec-9e4e-49af-9021-a8bee817e902 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128666 Jun 16 00:27:49.037336 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:49.049234 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-3a07f4f8-bc32-4814-8105-eab36eebdb4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:49.147359 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-3a07f4f8-bc32-4814-8105-eab36eebdb4f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101786 Jun 16 00:27:49.149927 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jun 16 00:27:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:27:51.381536 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-172359ec-9e4e-49af-9021-a8bee817e902 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:27:51.382556 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-172359ec-9e4e-49af-9021-a8bee817e902 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 16 00:27:51.382957 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:27:51.444541 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.517623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.128793 Jun 16 00:27:51.518755 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:27:51.530952 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-8857b93b-9268-4c3d-a1af-0ac90fcfc8a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:27:51.604104 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-8857b93b-9268-4c3d-a1af-0ac90fcfc8a2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076761 Jun 16 00:27:51.606841 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Thu Jun 16 00:27:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:28:15.339894 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:15.340926 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 16 00:28:15.341314 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:28:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:15.352286 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:15.399724 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-3bdc089d-7c9d-4f49-ae25-cc3f0e1118cf admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:15.417248 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-3bdc089d-7c9d-4f49-ae25-cc3f0e1118cf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070245 Jun 16 00:28:15.417772 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jun 16 00:28:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:28:16.379878 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.380913 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-14c326cc-759c-4ec7-a9f3-8ec471c58e94 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 16 00:28:16.381313 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:16.577939 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6be8536e-6d02-446c-8911-7c2b85383f6e admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.583713 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-6be8536e-6d02-446c-8911-7c2b85383f6e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6be8536e-6d02-446c-8911-7c2b85383f6e admin admin] Request method failure captured: Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Host: 10.222.0.20 Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqnkgG55GYyjx7c75uzRvKuUAd-Pow16V0syCqm_9EXOVpr7W6GY9NHU1hsVjYBuZi0SEY_SJ04UB67pecxaBoX13QfOkp4XJ88Kmt8v_z2bI6fhTmOFijW8sUiVQFZapEBsEkGZkhvW7RJEjXnYdv2gP6iJD0XN-0uD_1w6RnlF3ObM Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Role: reader,member,admin Jun 16 00:28:16.586970 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Roles: reader,member,admin Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: method: > Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: exception: Flavor 42 could not be found. Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: action_args: {'id': '42'} Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:16.588537 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:16.589428 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.590618 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-6be8536e-6d02-446c-8911-7c2b85383f6e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:16.591754 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-6be8536e-6d02-446c-8911-7c2b85383f6e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062311 Jun 16 00:28:16.591754 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:16.597891 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-99ed2780-895b-405e-a0e3-706902628fd6 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.601649 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:16.620576 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-99ed2780-895b-405e-a0e3-706902628fd6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026191 Jun 16 00:28:16.621102 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:28:16.630723 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-efa2e491-fec8-446b-8689-d1d500e66a68 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.651801 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-efa2e491-fec8-446b-8689-d1d500e66a68 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024731 Jun 16 00:28:16.652324 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:28:16.662190 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c3ec3912-27ae-44b9-a8c8-bad93ebe4c0e admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:16.667794 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-c3ec3912-27ae-44b9-a8c8-bad93ebe4c0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c3ec3912-27ae-44b9-a8c8-bad93ebe4c0e admin admin] Request method failure captured: Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept: application/json Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Connection: keep-alive Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Content-Length: 0 Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Host: 10.222.0.20 Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABiqnkgG55GYyjx7c75uzRvKuUAd-Pow16V0syCqm_9EXOVpr7W6GY9NHU1hsVjYBuZi0SEY_SJ04UB67pecxaBoX13QfOkp4XJ88Kmt8v_z2bI6fhTmOFijW8sUiVQFZapEBsEkGZkhvW7RJEjXnYdv2gP6iJD0XN-0uD_1w6RnlF3ObM Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Id: None Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Name: None Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Name: admin Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Role: reader,member,admin Jun 16 00:28:16.671056 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Roles: reader,member,admin Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant: admin Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User: admin Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Name: admin Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: method: > Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: exception: Flavor 42 could not be found. Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: action_args: {'id': '42'} Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:16.675032 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:16.675892 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:16.677623 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c3ec3912-27ae-44b9-a8c8-bad93ebe4c0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:16.678678 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-c3ec3912-27ae-44b9-a8c8-bad93ebe4c0e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014644 Jun 16 00:28:16.678678 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jun 16 00:28:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:17.621858 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-efa2e491-fec8-446b-8689-d1d500e66a68 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.622866 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-efa2e491-fec8-446b-8689-d1d500e66a68 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 16 00:28:17.623258 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:17.825675 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-e051ef2a-3933-448f-8ee3-559723c306c8 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.831684 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-e051ef2a-3933-448f-8ee3-559723c306c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-e051ef2a-3933-448f-8ee3-559723c306c8 admin admin] Request method failure captured: Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept: application/json Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Connection: keep-alive Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Content-Length: 0 Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Host: 10.222.0.20 Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABiqnkhYPwAO_2Oomr1Fh_VKTRf0rhkjMPFpftsLK6jalCjOelR2r-Yyi9hW3Qb_MMGE9Uav9ItSj8a-ywLG-pf_5dtyDfsX-_rDE_Hhlm9sCgUmhihLnu52dplyvUhyJ7RtDvxKOUwkW7S01MpsbGtV6Amwp217oQ2qioV9v61Nzv58Qw Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Id: None Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Name: None Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Name: admin Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Role: reader,member,admin Jun 16 00:28:17.833215 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Roles: reader,member,admin Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant: admin Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User: admin Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Name: admin Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: method: > Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: exception: Flavor 84 could not be found. Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: action_args: {'id': '84'} Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:17.835119 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:17.836100 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.837307 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-e051ef2a-3933-448f-8ee3-559723c306c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:17.838373 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-e051ef2a-3933-448f-8ee3-559723c306c8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065908 Jun 16 00:28:17.838373 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:17.845543 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-ba4aeee2-cf6e-4e88-a9ac-b33c6d046727 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.861211 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-ba4aeee2-cf6e-4e88-a9ac-b33c6d046727 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020190 Jun 16 00:28:17.861675 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:28:17.871619 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c7fe6b47-c258-4c2f-94e3-57295d2f93d3 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.885347 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-c7fe6b47-c258-4c2f-94e3-57295d2f93d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017231 Jun 16 00:28:17.885860 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:28:17.894865 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-2e6a83c0-f4a1-424d-8003-bd6b4ee6469b admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:17.900124 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-2e6a83c0-f4a1-424d-8003-bd6b4ee6469b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-2e6a83c0-f4a1-424d-8003-bd6b4ee6469b admin admin] Request method failure captured: Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Host: 10.222.0.20 Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqnkhYPwAO_2Oomr1Fh_VKTRf0rhkjMPFpftsLK6jalCjOelR2r-Yyi9hW3Qb_MMGE9Uav9ItSj8a-ywLG-pf_5dtyDfsX-_rDE_Hhlm9sCgUmhihLnu52dplyvUhyJ7RtDvxKOUwkW7S01MpsbGtV6Amwp217oQ2qioV9v61Nzv58Qw Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Role: reader,member,admin Jun 16 00:28:17.901641 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Roles: reader,member,admin Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: method: > Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: exception: Flavor 84 could not be found. Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: action_args: {'id': '84'} Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:17.903300 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:17.904270 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:17.905773 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-2e6a83c0-f4a1-424d-8003-bd6b4ee6469b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:17.907036 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-2e6a83c0-f4a1-424d-8003-bd6b4ee6469b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011650 Jun 16 00:28:17.907036 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Jun 16 00:28:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:18.766690 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-c7fe6b47-c258-4c2f-94e3-57295d2f93d3 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.767721 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-c7fe6b47-c258-4c2f-94e3-57295d2f93d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 16 00:28:18.768110 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:18.957310 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-91d356c8-341b-450c-bb1f-474356228ddc admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.963023 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.wsgi [None req-91d356c8-341b-450c-bb1f-474356228ddc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-91d356c8-341b-450c-bb1f-474356228ddc admin admin] Request method failure captured: Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept: application/json Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Accept-Encoding: gzip, deflate Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Connection: keep-alive Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Content-Length: 0 Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Host: 10.222.0.20 Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Openstack-System-Scope: None Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: User-Agent: python-novaclient Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Auth-Token: gAAAAABiqnkiEd4AK2hqXSHrIiJgrVNHc7y2ZouxKARDnXJUwYwHlodTLs1M1zAHeAZua7AenRbAO7h7nQbS9XO-pHzWqjEJ-jAjz-M2eDZncSH_zQwGzCvNWw9uEfDHfK3IrR8cSwy6ToUhp2pfEiKWkg0J9N-B4t90tMTKmo3Pqw95mXw2IAg Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Id: None Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Domain-Name: None Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Identity-Status: Confirmed Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Is-Admin-Project: True Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Id: default Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Domain-Name: Default Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Project-Name: admin Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Role: reader,member,admin Jun 16 00:28:18.964541 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Roles: reader,member,admin Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant: admin Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-Tenant-Name: admin Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User: admin Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Id: default Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Domain-Name: Default Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: X-User-Name: admin Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: method: > Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: exception: Flavor 451 could not be found. Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: action_args: {'id': '451'} Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:18.966031 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:18.966843 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: ERROR nova.api.openstack.wsgi Jun 16 00:28:18.967911 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-91d356c8-341b-450c-bb1f-474356228ddc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:18.968999 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-91d356c8-341b-450c-bb1f-474356228ddc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060183 Jun 16 00:28:18.968999 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:18.976123 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-72a3f115-62bf-422d-b2f8-8cdc06a0b3e5 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:18.989978 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-72a3f115-62bf-422d-b2f8-8cdc06a0b3e5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018150 Jun 16 00:28:18.990489 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:28:18.999751 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:19.013073 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016798 Jun 16 00:28:19.013599 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Jun 16 00:28:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:28:19.022777 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-80a6af07-e5e4-40d2-aca4-f1c16231d715 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:19.027949 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.wsgi [None req-80a6af07-e5e4-40d2-aca4-f1c16231d715 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-80a6af07-e5e4-40d2-aca4-f1c16231d715 admin admin] Request method failure captured: Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept: application/json Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Accept-Encoding: gzip, deflate Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Connection: keep-alive Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Content-Length: 0 Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Host: 10.222.0.20 Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-Api-Version: compute 2.90 Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Openstack-System-Scope: None Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: User-Agent: python-novaclient Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Auth-Token: gAAAAABiqnkiEd4AK2hqXSHrIiJgrVNHc7y2ZouxKARDnXJUwYwHlodTLs1M1zAHeAZua7AenRbAO7h7nQbS9XO-pHzWqjEJ-jAjz-M2eDZncSH_zQwGzCvNWw9uEfDHfK3IrR8cSwy6ToUhp2pfEiKWkg0J9N-B4t90tMTKmo3Pqw95mXw2IAg Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Id: None Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Domain-Name: None Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Identity-Status: Confirmed Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Is-Admin-Project: True Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Id: default Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Domain-Name: Default Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Project-Name: admin Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Role: reader,member,admin Jun 16 00:28:19.029446 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Roles: reader,member,admin Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_26e616646e114f6f885b0d1df925801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/26e616646e114f6f885b0d1df925801d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/26e616646e114f6f885b0d1df925801d"}]}] Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant: admin Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Id: 26e616646e114f6f885b0d1df925801d Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-Tenant-Name: admin Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User: admin Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Id: default Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Domain-Name: Default Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Id: 1aa1627cba2640fdb90f9d237f108268 Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: X-User-Name: admin Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: method: > Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: exception: Flavor 451 could not be found. Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: action_args: {'id': '451'} Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:28:19.031038 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:19.032030 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: ERROR nova.api.openstack.wsgi Jun 16 00:28:19.033382 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-80a6af07-e5e4-40d2-aca4-f1c16231d715 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:28:19.034644 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-80a6af07-e5e4-40d2-aca4-f1c16231d715 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011891 Jun 16 00:28:19.034644 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:28:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:19.938207 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:19.939241 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 16 00:28:19.939634 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:20.130487 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-b4467cf6-af5d-421e-9401-99a271f6746c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:20.205341 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-b4467cf6-af5d-421e-9401-99a271f6746c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.126279 Jun 16 00:28:20.205803 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jun 16 00:28:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:28:21.063953 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:21.064991 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 00:28:21.065380 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:21.263703 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-f32e8b5a-b611-452b-983e-a8bc6ff64a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:21.343959 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-f32e8b5a-b611-452b-983e-a8bc6ff64a1f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.131646 Jun 16 00:28:21.344429 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jun 16 00:28:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:28:22.209728 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:22.210720 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Jun 16 00:28:22.211109 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:22.404467 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-5365e988-89dc-46cf-a933-1f1787306413 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:22.504332 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-5365e988-89dc-46cf-a933-1f1787306413 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.150898 Jun 16 00:28:22.505412 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jun 16 00:28:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:28:23.363688 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:23.365288 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Jun 16 00:28:23.365676 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:23.554983 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-36f380dc-889c-41f2-84d0-746177427769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:28:23.665970 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-36f380dc-889c-41f2-84d0-746177427769 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.162506 Jun 16 00:28:23.666511 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Jun 16 00:28:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:28:24.526715 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.527716 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 16 00:28:24.528101 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:28:24.717640 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-0a1dd1b4-121a-45a7-905c-02815a6c1cb6 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:28:24.736939 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-0a1dd1b4-121a-45a7-905c-02815a6c1cb6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069724 Jun 16 00:28:24.737467 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Jun 16 00:28:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:12.501405 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.502413 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-a4a5a879-004e-4d29-97ca-14d3b5c2c05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 16 00:29:12.502809 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:29:12.513575 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:12.563027 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-ec309f4d-c3e4-4393-a789-7d09c71c3524 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.582183 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-ec309f4d-c3e4-4393-a789-7d09c71c3524 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073060 Jun 16 00:29:12.582714 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:29:12.606144 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-2e10603d-1a5e-4fb9-bd14-25cfe457def8 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.609556 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG dbcounter [-] [110283] Writing DB stats nova_api:SELECT=14 {{(pid=110283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:12.615115 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-2e10603d-1a5e-4fb9-bd14-25cfe457def8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012585 Jun 16 00:29:12.623290 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.627165 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-7c03fc70-cec5-4bdf-a4de-d85e46304e9e admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.635151 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-7c03fc70-cec5-4bdf-a4de-d85e46304e9e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011937 Jun 16 00:29:12.635674 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.646712 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.654453 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011279 Jun 16 00:29:12.654966 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:29:12.666344 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-751e1e2b-4803-4648-a9b8-ae83ce26a4bb admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:29:12.673646 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-751e1e2b-4803-4648-a9b8-ae83ce26a4bb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010702 Jun 16 00:29:12.674138 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Thu Jun 16 00:29:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:32:35.244692 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:35.245701 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 16 00:32:35.246087 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:32:35.406852 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=6 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:35.519775 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:35.521931 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:32:35.521931 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:32:35.522743 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:35.523916 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:35.525375 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:35.525812 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:35.561077 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-98db5425-a209-4b84-97c7-327b369a2fd4 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155727 Jun 16 00:32:35.561885 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:32:35 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:32:36.447994 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:36.449048 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 16 00:32:36.449476 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:32:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:36.640129 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:36.641333 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:32:36.641333 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:32:36.642501 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:36.642934 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:36.643705 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:36.644132 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:36.662959 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-3aee5558-df75-4983-8504-50ff121e0b77 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074235 Jun 16 00:32:36.663418 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:32:36 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:32:47.954652 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:47.955653 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 16 00:32:47.956045 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:32:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:48.101047 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell0:SELECT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:48.101806 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_cell1:SELECT=4 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:48.102427 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG dbcounter [-] [110284] Writing DB stats nova_api:SELECT=8 {{(pid=110284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:48.150593 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:48.156273 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:48.179259 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-a6f74a46-8434-4af3-9f40-39625896a72a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083177 Jun 16 00:32:48.179747 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:32:48 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:32:49.042519 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: DEBUG nova.api.openstack.wsgi [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] Calling method '>' {{(pid=110283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:49.043519 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: INFO nova.api.openstack.requestlog [None req-def0718d-fe50-4866-bc40-88f3f51074c0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 16 00:32:49.043908 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: [pid: 110283|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Jun 16 00:32:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:32:49.233662 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG nova.api.openstack.wsgi [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] Calling method '>' {{(pid=110284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:32:49.234816 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:32:49.234816 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: warnings.warn(msg) Jun 16 00:32:49.236013 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.236455 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.237263 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:32:49.237690 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: DEBUG oslo_concurrency.lockutils [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:32:49.259363 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: INFO nova.api.openstack.requestlog [None req-035ac16a-ad67-4010-997a-f314b9b20b55 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076928 Jun 16 00:32:49.259840 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: [pid: 110284|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Jun 16 00:32:49 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:33:43.932247 dv-cinder-803823-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 00:33:43.932973 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: Thu Jun 16 00:33:43 2022 - graceful shutdown triggered... Jun 16 00:33:43.933558 dv-cinder-803823-11-iscsi devstack@n-api.service[110284]: Gracefully killing worker 2 (pid: 110284)... Jun 16 00:33:43.933952 dv-cinder-803823-11-iscsi devstack@n-api.service[110283]: Gracefully killing worker 1 (pid: 110283)... Jun 16 00:33:44.934663 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: worker 1 buried after 1 seconds Jun 16 00:33:44.935151 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: worker 2 buried after 1 seconds Jun 16 00:33:44.935151 dv-cinder-803823-11-iscsi devstack@n-api.service[110282]: goodbye to uWSGI. Jun 16 00:33:44.936236 dv-cinder-803823-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 00:33:44.936798 dv-cinder-803823-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 00:33:44.939797 dv-cinder-803823-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 00:33:44.954184 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:33:44 2022] *** Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: nodename: dv-cinder-803823-11-iscsi Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: machine: x86_64 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: clock source: unix Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: pcre jit disabled Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: detected number of CPU cores: 4 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: current working directory: / Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: your processes number limit is 47680 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: your memory page size is 4096 bytes Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: detected max file descriptor number: 2048 Jun 16 00:33:44.956933 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: lock engine: pthread robust mutexes Jun 16 00:33:44.958155 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: thunder lock: enabled Jun 16 00:33:44.958155 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 00:33:44.958155 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:33:45.005839 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: Python main interpreter initialized at 0x5613fd3449c0 Jun 16 00:33:45.005839 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: python threads support enabled Jun 16 00:33:45.005839 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: your server socket listen backlog is limited to 100 connections Jun 16 00:33:45.005839 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:33:45.006289 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:33:45.006289 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: *** Operational MODE: preforking *** Jun 16 00:33:45.006570 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:33:45.006570 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: spawned uWSGI master process (pid: 124706) Jun 16 00:33:45.006772 dv-cinder-803823-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 00:33:45.007496 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: spawned uWSGI worker 1 (pid: 124721, cores: 1) Jun 16 00:33:45.007724 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: spawned uWSGI worker 2 (pid: 124722, cores: 1) Jun 16 00:33:45.010154 dv-cinder-803823-11-iscsi devstack@n-api.service[124706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:33:45.672050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:33:45.719268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 00:33:46.926189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:33:46.926189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: from cryptography.utils import int_from_bytes Jun 16 00:33:46.926795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:33:46.926795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: from cryptography.utils import int_from_bytes Jun 16 00:33:46.989313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:33:46.989313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: from cryptography.utils import int_from_bytes Jun 16 00:33:46.989960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:33:46.989960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: from cryptography.utils import int_from_bytes Jun 16 00:33:49.391638 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:33:49.392166 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:33:49.392453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:33:49.392730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:33:49.392995 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:33:49.393394 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.393802 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.394608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.394940 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.395282 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.395603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.395932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.396259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.396622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.396895 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.397219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.397554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-11-iscsi {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.397887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.398204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.398535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.398851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.399159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.399488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.399801 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.400308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.401865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.401865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.401865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.401865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-11-iscsi {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.409257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.410423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.411456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.412761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413248 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413248 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413248 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413491 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.413988 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.414302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.414617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.414936 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.415250 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.415562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.415875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.416259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.416608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.416943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.417259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.417588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.417997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.418255 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.418574 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.418925 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.419251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.419572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.419899 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.420228 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.420578 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.420924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.421245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.421573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.421919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:33:49.422399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.422562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:33:49.422732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.422732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.423038 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:33:49.423197 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.423563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:33:49.423724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.423873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:33:49.424036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.424036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.424323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.424470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.424902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.425095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.425263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.425480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.425673 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.425838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.426084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.426360 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.426522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.426522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.426837 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427493 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.427975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.428144 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.428293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-11-iscsi {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.428448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.428672 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.428843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429651 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429806 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.429982 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.430772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.431989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.432284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.432284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.432599 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.432761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.432909 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433064 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433220 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433375 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433536 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433702 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.433995 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434460 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-11-iscsi {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.434916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435223 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.435999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.436148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.436406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.436605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.436761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.436909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.437072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.437222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.437369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.437775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.437942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438559 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.438877 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439040 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.439978 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.440175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.440339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.440495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.440704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.440861 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.441019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.441204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.441566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.441726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.441884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.442033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.442211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.442369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.442518 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.442669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.442787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.442910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.442910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.443130 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.443244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.443366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.443491 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.443623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.443745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.443868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.443989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.444103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.444225 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.444347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.444474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.450454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.450762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.450932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.451094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.451245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.451526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.451784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.451991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.452146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.452311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.452467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.452651 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.452811 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.452958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.454386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.454503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.454595 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.454679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.454753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.454832 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.454918 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.454998 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.454998 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.455159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.455244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.455317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.455317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.455477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.455477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.455817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.455899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.455984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.455984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.456145 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.456229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.456342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.456342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.456500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.457272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.457368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.457455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.457545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.457640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.457757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.457851 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.457942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.458028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.458117 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.458210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.458324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.458430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.458512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.458620 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.458705 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.458837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.458947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.459123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.459297 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.459484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.459669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.459836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.459979 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.460149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.460329 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.460504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460609 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.460692 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.460874 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.460959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.461135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.461359 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.461535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.461697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461786 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.461872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.461963 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.462163 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.462354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.462530 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.462697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.462871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.462961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463053 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.463137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463226 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.463317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.463496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463587 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.463678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.463860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.463950 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464043 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.464134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.464394 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.464597 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.464767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.464857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.464948 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.465033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.465128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.465213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.465561 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.465667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.465761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.465847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.465981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.466140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466224 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.466316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.466498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466582 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.466664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466747 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.466829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.466921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.467100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.467256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.467503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:33:49.467673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.467929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468021 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468362 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468859 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.468945 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469035 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469217 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.469812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470663 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.470975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471723 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.471999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.472116 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.472840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.472970 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.478693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.478832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.478927 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479013 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479376 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479469 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479637 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479900 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.479990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480253 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.480967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481298 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481384 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481473 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.481982 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482396 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482655 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482893 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.482985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483235 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483327 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483502 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.483761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.488228 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.488959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489567 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.489922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490042 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490163 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490395 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.490974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491586 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491671 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491760 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.491944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.492932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493557 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493641 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.493985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494344 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494519 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494519 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.494942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495106 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.495943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496121 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496211 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496296 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496389 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496514 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.496884 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497012 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.497932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498089 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498386 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498515 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.498889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499534 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.499938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.500066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.500210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.500340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.500479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.512600 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.512748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.512901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513035 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513169 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513576 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.513938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514031 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514123 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514302 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514525 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514525 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.514957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515043 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515302 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515651 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.515934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516354 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516700 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516880 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.516964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517413 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517497 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517725 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.517963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518224 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518674 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.518935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.519596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.519807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.519912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520000 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520356 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520674 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520774 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.520959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521559 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521781 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.521967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522053 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522220 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.522913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.523967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524061 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524153 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524740 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.524927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.525934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526353 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526353 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526619 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526739 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.526975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527420 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527595 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.527994 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.528886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.529943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530516 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530693 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530873 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.530957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531132 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531692 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.531981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532409 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532554 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532647 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.532732 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533187 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533643 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.533962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534061 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534148 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.534738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535318 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535493 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535578 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.535930 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536799 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.536980 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537165 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.537989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538502 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538593 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538778 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.538956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539046 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539139 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539388 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539656 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.539994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540393 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540689 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.540916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541223 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541522 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.541843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542684 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.542997 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543722 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.543929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544240 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544341 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544658 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544885 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.544990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545359 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545508 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.545994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.546941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547035 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.547926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548581 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.548997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.549923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550574 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.550878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551089 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551498 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.551813 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552020 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552130 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552480 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.552822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.553003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.553140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.553802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.553941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554194 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554319 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.554947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555089 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.555890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556020 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556728 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.556905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557061 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557676 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.557968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558567 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.558964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559106 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.559897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.560944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.561862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.562029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.562169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.562340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.562748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.562927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563564 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.563881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564032 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564197 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564564 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564694 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.564880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.567571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.567665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.567761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.567851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.567935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.568916 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569250 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569875 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.569875 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570040 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570457 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.570909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571201 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.571909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.572875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573086 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573186 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.573815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574375 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574475 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.574794 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575409 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.575938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576253 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576604 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.576917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.577981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578167 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.578968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.579206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.579326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.579515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.579640 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.579860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580011 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.580987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.581162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.581305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.581482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582776 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.582957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583274 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.583908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584366 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584703 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.584887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585553 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.585867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.586908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587097 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.587835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588469 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588719 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.588826 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.589996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.590944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591378 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591584 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591706 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.591894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592015 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.592876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.593970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594600 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.594899 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595224 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595525 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.595860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.596051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.596195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.596377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.596510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.596724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.597875 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.598888 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599220 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599702 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.599844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.600815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601655 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601749 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.601972 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602703 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.602922 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.603862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604501 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.604876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605198 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.605864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606078 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606390 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.606813 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607646 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.607961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.608924 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.609956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.610173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.610274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.610492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.610592 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.610801 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611489 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611706 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.611799 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612013 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612160 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612326 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612648 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.612985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613407 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.613923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614220 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614657 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.614942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615251 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.615928 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.616902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617112 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617534 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.617862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.618814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619601 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.619927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620349 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620597 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.620914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621319 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621643 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.621958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622276 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622501 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.622917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.623988 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.624988 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625119 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625428 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.625932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626335 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.626966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627182 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627493 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.627904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.628124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.628218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.628958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.629910 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630129 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630583 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630803 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.630896 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631465 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631558 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.631887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632099 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632769 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.632863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633716 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.633815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634751 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.634968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635687 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.635903 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636653 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.636872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637009 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637182 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637275 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.637897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638416 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638517 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638723 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.638818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639030 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.639956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640594 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640905 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.640999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641317 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641524 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641888 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.641997 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642160 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642447 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.642855 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643063 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.643797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.644059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.644701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.644922 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.645898 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646122 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646223 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646552 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646794 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.646894 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647208 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647420 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.647836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648160 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648716 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.648820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649352 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.649981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650297 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.650925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651553 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.651975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652652 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.652992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653806 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.653905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.654891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.655790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656343 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.656774 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657051 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657153 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657509 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.657817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.658916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:33:49.659009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.659304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.659645 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.659969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.660303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.660671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.661007 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.661336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.661647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.661958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.662277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.662596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.662918 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.663231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.663540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.663849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.664162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.664470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.664805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.665111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.665585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.665907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.666216 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.666524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.666832 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.667141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.667451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.667761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.668074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.668381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.668715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.669023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.669331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.669637 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.669974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.670310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.670630 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.670955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.671268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.671594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.671908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.672238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.672585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.672904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.673216 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.673551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.673867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.674183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.674498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.674816 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.675131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.675474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.675810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.676142 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.676457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.676813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.677135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.677460 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.677779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.678097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.678433 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.678749 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.679063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.679382 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.679696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.680013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.680340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.680686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.681018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.681347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.681665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.681996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.682330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.682680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.682999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.683345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.683677 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.683996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.684311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.684642 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:33:49.684891 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:33:49.727459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO dbcounter [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Registered counter for database nova_api Jun 16 00:33:49.747291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_db.sqlalchemy.engines [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.752268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO dbcounter [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Registered counter for database nova_api Jun 16 00:33:49.754399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writer thread running {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.773213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_db.sqlalchemy.engines [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.779783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writer thread running {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.811929 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.context [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05a3bc2a-bfb9-434c-ae77-5f7d553f0730(cell1) {{(pid=124722) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:33:49.816924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.818513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.819308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.821308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.823308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO dbcounter [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Registered counter for database nova_cell0 Jun 16 00:33:49.827182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO dbcounter [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Registered counter for database nova_cell1 Jun 16 00:33:49.836262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_db.sqlalchemy.engines [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.838125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_db.sqlalchemy.engines [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.841601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.context [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05a3bc2a-bfb9-434c-ae77-5f7d553f0730(cell1) {{(pid=124721) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 00:33:49.844396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writer thread running {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.847093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writer thread running {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.847592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.849251 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.850366 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:33:49.852422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:33:49.854931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO dbcounter [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Registered counter for database nova_cell0 Jun 16 00:33:49.861120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO dbcounter [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Registered counter for database nova_cell1 Jun 16 00:33:49.872103 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_db.sqlalchemy.engines [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.873345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_db.sqlalchemy.engines [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:49.881387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writer thread running {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.881731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writer thread running {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:49.999762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO dbcounter [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Registered counter for database nova_cell0 Jun 16 00:33:50.007046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_db.sqlalchemy.engines [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:50.011960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writer thread running {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:50.030155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO dbcounter [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Registered counter for database nova_cell0 Jun 16 00:33:50.036887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_db.sqlalchemy.engines [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:33:50.041552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writer thread running {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:33:50.344234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: WARNING keystonemiddleware.auth_token [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:33:50.352258 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: WARNING keystonemiddleware.auth_token [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:33:50.366556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: WARNING keystonemiddleware.auth_token [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:33:50.373923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: WARNING keystonemiddleware.auth_token [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:33:50.699348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: WARNING keystonemiddleware.auth_token [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:33:50.705362 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: WARNING keystonemiddleware.auth_token [None req-56880fe0-8f02-4ed2-8c03-8e99e85c3678 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:33:50.710679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613fd3449c0 pid: 124722 (default app) Jun 16 00:33:50.726584 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: WARNING keystonemiddleware.auth_token [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 00:33:50.732556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: WARNING keystonemiddleware.auth_token [None req-5051203c-2d74-44d9-abca-42d40852b15c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 00:33:50.737926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613fd3449c0 pid: 124721 (default app) Jun 16 00:34:32.570426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.571298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.572058 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.572799 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.803807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.805305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.806583 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:32.807578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:33.383461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ac7c3f9b-2fe6-4469-a115-d30bae707a39 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Action: 'create', calling method: .version_select at 0x7f2a8139f790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-618952287"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:33.560846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37b7fcc7-2875-48e7-8a58-c27b89c607a3 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Action: 'create', calling method: .version_select at 0x7f2a813a5940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-263309225", "metadata": {"Type": "work"}}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37b7fcc7-2875-48e7-8a58-c27b89c607a3 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 121 Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:33.580543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-263309225", "metadata": {"Type": "work"}}} Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:33.582192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-263309225', 'metadata': {'Type': 'work'}}}} Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:33.583236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:34:33.589759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:34:33.591170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 00:34:33.591170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.591170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37b7fcc7-2875-48e7-8a58-c27b89c607a3 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:33.591170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-37b7fcc7-2875-48e7-8a58-c27b89c607a3 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.790110 Jun 16 00:34:33.591170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jun 16 00:34:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 792 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:34:33.595442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2e570e4b-33a3-4e8a-adc2-94658bbcab0e tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Action: 'create', calling method: .version_select at 0x7f2a81332af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-126995127", "metadata": {"Type": "work"}}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2e570e4b-33a3-4e8a-adc2-94658bbcab0e tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 119 Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:33.598809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-126995127", "metadata": {"Type": "work"}}} Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:33.600436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-126995127', 'metadata': {'Type': 'work'}}}} Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi '0' Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:33.601931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:34:33.603571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:34:33.605155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 00:34:33.605155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.615121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2e570e4b-33a3-4e8a-adc2-94658bbcab0e tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:33.616606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2e570e4b-33a3-4e8a-adc2-94658bbcab0e tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030213 Jun 16 00:34:33.623174 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jun 16 00:34:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:34:33.636087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ef20fa71-d042-44e9-bee4-47ca13bc04d9 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Action: 'create', calling method: .version_select at 0x7f2a813a5940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-253420213", "metadata": {"Type": "work"}}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ef20fa71-d042-44e9-bee4-47ca13bc04d9 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 118 Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:33.640983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-253420213", "metadata": {"Type": "work"}}} Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:33.642325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-253420213', 'metadata': {'Type': 'work'}}}} Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise error Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi '' Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:33.643125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 00:34:33.644543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 00:34:33.646858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 00:34:33.646858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:33.646858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ef20fa71-d042-44e9-bee4-47ca13bc04d9 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:33.646858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ef20fa71-d042-44e9-bee4-47ca13bc04d9 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014840 Jun 16 00:34:33.646858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 3/3] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jun 16 00:34:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:34:33.666710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8b920dc3-746d-476e-9e7e-1759b0fab7b7 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Calling method '.version_select at 0x7f2a812cf820>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:34.072108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-8b920dc3-746d-476e-9e7e-1759b0fab7b7 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] HTTP exception thrown: Volume tempest-invalid-1456956120 could not be found. Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8b920dc3-746d-476e-9e7e-1759b0fab7b7 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1456956120 HTTP/1.1 Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:34.075925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Volume tempest-invalid-1456956120 could not be found. Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'tempest-invalid-1456956120'} Jun 16 00:34:34.080036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1456956120 could not be found. (HTTP 404) (Request-ID: req-7cab9276-30ef-4d49-b152-d27a53497a7b) Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.083452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:34.089814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1456956120 could not be found. Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:34.093913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1456956120 could not be found. Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1456956120 could not be found. Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8b920dc3-746d-476e-9e7e-1759b0fab7b7 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 404 to user: Volume tempest-invalid-1456956120 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8b920dc3-746d-476e-9e7e-1759b0fab7b7 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1456956120" status: 404 len: 99 microversion: 2.1 time: 0.429458 Jun 16 00:34:34.095810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:34:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1456956120 => generated 99 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:34:34.097287 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fb80312a-ac42-4874-b6f0-74275537add3 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003989 Jun 16 00:34:34.101473 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 5/5] 10.222.0.20 () {58 vars in 1139 bytes} [Thu Jun 16 00:34:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 00:34:34.106190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c0677f40-269e-4085-a99d-eacb7ed42526 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003716 Jun 16 00:34:34.106838 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 6/6] 10.222.0.20 () {58 vars in 1136 bytes} [Thu Jun 16 00:34:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 00:34:34.116367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d19a789a-f32c-448b-911a-e06b7faa34ec tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Calling method '.version_select at 0x7f2a8120b040>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:34.146132 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-d19a789a-f32c-448b-911a-e06b7faa34ec tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] HTTP exception thrown: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d19a789a-f32c-448b-911a-e06b7faa34ec tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/os-volumes/81e6e16a-4042-468a-bc93-1caab097762f HTTP/1.1 Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:34.148060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '81e6e16a-4042-468a-bc93-1caab097762f'} Jun 16 00:34:34.149617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. (HTTP 404) (Request-ID: req-00034512-d149-4c4a-806f-6456f031224f) Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.150968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:34.152126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:34:34.153304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d19a789a-f32c-448b-911a-e06b7faa34ec tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 404 to user: Volume 81e6e16a-4042-468a-bc93-1caab097762f could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d19a789a-f32c-448b-911a-e06b7faa34ec tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/81e6e16a-4042-468a-bc93-1caab097762f" status: 404 len: 109 microversion: 2.1 time: 0.037178 Jun 16 00:34:34.154735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 7/7] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:34:34 2022] DELETE /compute/v2.1/os-volumes/81e6e16a-4042-468a-bc93-1caab097762f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:34.160270 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fb894c65-d61c-4910-9e2c-835fb3b98761 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Calling method '.version_select at 0x7f2a811ecdc0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:34.191386 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-fb894c65-d61c-4910-9e2c-835fb3b98761 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] HTTP exception thrown: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fb894c65-d61c-4910-9e2c-835fb3b98761 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Request method failure captured: Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/os-volumes/27f0af02-faf9-4551-a575-4e468016ce60 HTTP/1.1 Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYBhi7k1_ePUKMPqDyEtWgd8EV7LcQnRp8lmY_nmfvhuyB0QId-tkLuw721DCOom21UjMjsNKWd6m-eb-u-YeXz0bbl2Vr2g1X-Y_LxWiNIX_ubINnWatyzqAf0sEJ2D3Md5CO8SAV-IjfqP_jYdce3sTVWJTvFhhmSuclROR2krA Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:34.193447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_704cb48b399648e08be940e082da2c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/704cb48b399648e08be940e082da2c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/704cb48b399648e08be940e082da2c3e"}]}] Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 704cb48b399648e08be940e082da2c3e Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesNegativeTest-411214156 Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f697f7f3ddc142cba550e2385b26552f Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesNegativeTest-411214156-project Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '27f0af02-faf9-4551-a575-4e468016ce60'} Jun 16 00:34:34.194920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. (HTTP 404) (Request-ID: req-fab2fac1-be81-452a-825d-cdafd4d60f15) Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.195802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:34.197320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:34:34.199511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fb894c65-d61c-4910-9e2c-835fb3b98761 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] Returning 404 to user: Volume 27f0af02-faf9-4551-a575-4e468016ce60 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:34.200935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fb894c65-d61c-4910-9e2c-835fb3b98761 tempest-VolumesNegativeTest-411214156 tempest-VolumesNegativeTest-411214156-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/27f0af02-faf9-4551-a575-4e468016ce60" status: 404 len: 109 microversion: 2.1 time: 0.038989 Jun 16 00:34:34.203596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 8/8] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:34 2022] GET /compute/v2.1/os-volumes/27f0af02-faf9-4551-a575-4e468016ce60 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:34:34.957024 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ac7c3f9b-2fe6-4469-a115-d30bae707a39 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.388997 Jun 16 00:34:34.963876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 1/9] 10.222.0.20 () {60 vars in 1154 bytes} [Thu Jun 16 00:34:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 00:34:34.974847 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-eb3fdd39-a75d-4cb7-9c19-738b55a7144b tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a8120b9d0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:35.048399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7e19f088-fa9c-43e6-a13e-3a03eddfe0d0 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a812685e0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:35.178272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-eb3fdd39-a75d-4cb7-9c19-738b55a7144b tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 200 len: 344 microversion: 2.1 time: 0.210748 Jun 16 00:34:35.184448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 9/10] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:34 2022] GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:35.188366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7e19f088-fa9c-43e6-a13e-3a03eddfe0d0 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f40e19ba-28a6-4248-aa33-85580d5b9769" status: 200 len: 349 microversion: 2.1 time: 0.145901 Jun 16 00:34:35.189216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 2/11] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:35 2022] GET /compute/v2.1/os-volumes/f40e19ba-28a6-4248-aa33-85580d5b9769 => generated 349 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:36.191955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8dd5a831-34e4-460f-bbaf-bcd6e1885dda tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a811ecd30>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:36.567392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8dd5a831-34e4-460f-bbaf-bcd6e1885dda tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 200 len: 345 microversion: 2.1 time: 0.139290 Jun 16 00:34:36.567392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 10/12] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:36 2022] GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:36.569438 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cd3178a4-230b-47be-aa64-a4139ba1671f tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Action: 'create', calling method: .version_select at 0x7f2a81268820>, body: {"snapshot": {"volume_id": "b4df28cb-84d3-4afd-a4dc-d1033cc23e4f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-805164876"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:37.134112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-72b5a73f-f558-4506-817a-07314a452e3c tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a8120b280>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:37.262662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-72b5a73f-f558-4506-817a-07314a452e3c tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/73548072-0f06-4e90-9e8f-6aaef06f9d0a" status: 200 len: 351 microversion: 2.1 time: 0.137452 Jun 16 00:34:37.264042 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 11/13] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:37 2022] GET /compute/v2.1/os-volumes/73548072-0f06-4e90-9e8f-6aaef06f9d0a => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:37.432247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cd3178a4-230b-47be-aa64-a4139ba1671f tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.095345 Jun 16 00:34:37.437120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 3/14] 10.222.0.20 () {60 vars in 1161 bytes} [Thu Jun 16 00:34:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:37.450054 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3ee8b30b-7b32-42ac-83c6-f230c33db262 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a8120b700>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:37.508990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3ee8b30b-7b32-42ac-83c6-f230c33db262 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.065034 Jun 16 00:34:37.522499 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-514f69e7-9263-4a69-b86a-2140ab3ff914 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81283280>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:37.525037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 12/15] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:37 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:37.646341 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-514f69e7-9263-4a69-b86a-2140ab3ff914 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.130688 Jun 16 00:34:37.652348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 4/16] 10.222.0.20 () {58 vars in 1139 bytes} [Thu Jun 16 00:34:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:37.660854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-55ef54ac-d485-46fc-8c3e-5549ceb0c134 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a811973a0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:37.733561 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-55ef54ac-d485-46fc-8c3e-5549ceb0c134 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.079673 Jun 16 00:34:37.738068 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 13/17] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:37 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:38.745213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-442b10ad-5c9b-4f44-aa01-308f3b376171 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81283f70>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:38.961055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-442b10ad-5c9b-4f44-aa01-308f3b376171 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.219623 Jun 16 00:34:38.962184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 5/18] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:38 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:39.974797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f3ead857-4ec9-4d38-9122-d85132352566 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a8120bb80>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:40.035381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f3ead857-4ec9-4d38-9122-d85132352566 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.065919 Jun 16 00:34:40.036921 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 14/19] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:39 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:41.050273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-420c59b1-4e89-4f69-9734-f1d8e86e04e6 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a812833a0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:41.096633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-420c59b1-4e89-4f69-9734-f1d8e86e04e6 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.052296 Jun 16 00:34:41.100659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 6/20] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:41 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:41.647033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3c042a23-0040-4970-b8fc-446714b4fdaa tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a811ec8b0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:41.754697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3c042a23-0040-4970-b8fc-446714b4fdaa tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/dce2894f-3433-4216-b9f8-6d2ae6b53a81" status: 200 len: 351 microversion: 2.1 time: 0.111499 Jun 16 00:34:41.755576 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 15/21] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:41 2022] GET /compute/v2.1/os-volumes/dce2894f-3433-4216-b9f8-6d2ae6b53a81 => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:41.767701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-eca62d2d-74dc-42a2-9990-595d8869880d tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a81283160>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:41.967941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-eca62d2d-74dc-42a2-9990-595d8869880d tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.204705 Jun 16 00:34:41.969171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 7/22] 10.222.0.20 () {58 vars in 1133 bytes} [Thu Jun 16 00:34:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:41.983563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8692a342-bfe5-4d1b-945f-54e49e472076 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a811ecee0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.109171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-552e1358-9f6e-4c98-bd30-21cea9d163c8 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a812684c0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.174081 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-552e1358-9f6e-4c98-bd30-21cea9d163c8 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 287 microversion: 2.1 time: 0.069462 Jun 16 00:34:42.175206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 8/23] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:42.189881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-13e14bfd-7c45-4f39-82a7-fca426fa78dc tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81283af0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.239226 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8692a342-bfe5-4d1b-945f-54e49e472076 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.260631 Jun 16 00:34:42.239858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 16/24] 10.222.0.20 () {58 vars in 1148 bytes} [Thu Jun 16 00:34:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:42.254687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-619c559c-13db-4ccb-80f7-123645b7c622 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a811ecca0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.430929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-619c559c-13db-4ccb-80f7-123645b7c622 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.182344 Jun 16 00:34:42.439556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 17/25] 10.222.0.20 () {58 vars in 1133 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:42.441037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-13e14bfd-7c45-4f39-82a7-fca426fa78dc tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 202 len: 0 microversion: 2.1 time: 0.254319 Jun 16 00:34:42.441037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 9/26] 10.222.0.20 () {58 vars in 1253 bytes} [Thu Jun 16 00:34:42 2022] DELETE /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:42.446624 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d39c8007-e1da-4579-88b4-1f3b5eb83e6a tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a8120b550>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.450717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1334a296-8fd3-46aa-9b8a-0ba35eb1df1e tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81283670>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.526491 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1334a296-8fd3-46aa-9b8a-0ba35eb1df1e tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 200 len: 286 microversion: 2.1 time: 0.083995 Jun 16 00:34:42.527072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 10/27] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:42.645550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d39c8007-e1da-4579-88b4-1f3b5eb83e6a tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203892 Jun 16 00:34:42.646520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 18/28] 10.222.0.20 () {58 vars in 1166 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:42.658632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b8e84bea-323c-4796-843b-1a36ce061cfe tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a812688b0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:42.858606 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b8e84bea-323c-4796-843b-1a36ce061cfe tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.204528 Jun 16 00:34:42.859306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 11/29] 10.222.0.20 () {58 vars in 1169 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:42.871902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e52d14ea-89ea-47d6-9c46-9d65e6498aae tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a81197280>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:43.065631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e52d14ea-89ea-47d6-9c46-9d65e6498aae tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197502 Jun 16 00:34:43.069720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 19/30] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Jun 16 00:34:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:43.087726 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9073966c-8661-42fd-bb91-bc2c8b545da2 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a81283820>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:43.287520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9073966c-8661-42fd-bb91-bc2c8b545da2 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203821 Jun 16 00:34:43.288842 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 12/31] 10.222.0.20 () {58 vars in 1187 bytes} [Thu Jun 16 00:34:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:43.300999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c39928b5-8844-4efc-aeac-d8f4b9ecdbe7 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] Calling method '.version_select at 0x7f2a811ecca0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:43.467694 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c39928b5-8844-4efc-aeac-d8f4b9ecdbe7 tempest-VolumesTestJSON-1783689442 tempest-VolumesTestJSON-1783689442-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.170799 Jun 16 00:34:43.468821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 20/32] 10.222.0.20 () {58 vars in 1154 bytes} [Thu Jun 16 00:34:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:43.539557 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2100a89c-5d63-4411-9c8f-7a77b734d28c tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81268ee0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:43.632138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-2100a89c-5d63-4411-9c8f-7a77b734d28c tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] HTTP exception thrown: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2100a89c-5d63-4411-9c8f-7a77b734d28c tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Request method failure captured: Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 HTTP/1.1 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqYizRYuiRb5b3eHJtcbnh30N-R-TrLYMg3vetjhIfBf7Rje19wsI_3s5u-RAW56dxTFqm3Y7YIWtoX-naMBX84NaUJS0ORH2ALecf-x4YaybKdZwf-xL3Z5lx3OxdRGmW25saDlpOJsKpfHVmYwxnKj4RJ3g5HFiFkVXY0_Op8onU Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:34:43.637189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}] Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 8166ce98a4d94d10aa6c28e84fa93fba Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '359f545a-f730-494c-b734-b9134b61ee92'} Jun 16 00:34:43.638614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. (HTTP 404) (Request-ID: req-5f4e5d7c-e63c-44ac-8ee5-f3af85fbff61) Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.639502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:43.640422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 00:34:43.647366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2100a89c-5d63-4411-9c8f-7a77b734d28c tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Returning 404 to user: Snapshot 359f545a-f730-494c-b734-b9134b61ee92 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:43.648765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2100a89c-5d63-4411-9c8f-7a77b734d28c tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92" status: 404 len: 111 microversion: 2.1 time: 0.108292 Jun 16 00:34:43.655397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8936a704-c888-46a0-ad78-eabe8641a20b tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a814528b0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:43.667927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 13/33] 10.222.0.20 () {58 vars in 1250 bytes} [Thu Jun 16 00:34:43 2022] GET /compute/v2.1/os-snapshots/359f545a-f730-494c-b734-b9134b61ee92 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:44.017236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8936a704-c888-46a0-ad78-eabe8641a20b tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 202 len: 0 microversion: 2.1 time: 0.366078 Jun 16 00:34:44.025920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 21/34] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:34:43 2022] DELETE /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:34:44.028262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b7213f77-c50c-4ce4-8781-a36658c1715e tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a811f1160>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:44.094756 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b7213f77-c50c-4ce4-8781-a36658c1715e tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 200 len: 344 microversion: 2.1 time: 0.071423 Jun 16 00:34:44.102381 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 14/35] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:44 2022] GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:34:45.110264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b6ada6b2-6c57-4500-b7ff-16cb7a50db08 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81332790>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:45.160338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-b6ada6b2-6c57-4500-b7ff-16cb7a50db08 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] HTTP exception thrown: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b6ada6b2-6c57-4500-b7ff-16cb7a50db08 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Request method failure captured: Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f HTTP/1.1 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYizRYuiRb5b3eHJtcbnh30N-R-TrLYMg3vetjhIfBf7Rje19wsI_3s5u-RAW56dxTFqm3Y7YIWtoX-naMBX84NaUJS0ORH2ALecf-x4YaybKdZwf-xL3Z5lx3OxdRGmW25saDlpOJsKpfHVmYwxnKj4RJ3g5HFiFkVXY0_Op8onU Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:45.162560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}] Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 8166ce98a4d94d10aa6c28e84fa93fba Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'b4df28cb-84d3-4afd-a4dc-d1033cc23e4f'} Jun 16 00:34:45.163793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. (HTTP 404) (Request-ID: req-c244aec2-59cf-4890-a7a3-16c66b1dc1b7) Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.164437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:45.165410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:34:45.166351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.167332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.198829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b6ada6b2-6c57-4500-b7ff-16cb7a50db08 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Returning 404 to user: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:45.198829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b6ada6b2-6c57-4500-b7ff-16cb7a50db08 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 404 len: 109 microversion: 2.1 time: 0.081450 Jun 16 00:34:45.199882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 22/36] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:45 2022] GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:45.203446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-add0bd3d-28fd-442d-a5df-27082ef1f547 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a811f1820>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:45.281452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-add0bd3d-28fd-442d-a5df-27082ef1f547 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] HTTP exception thrown: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-add0bd3d-28fd-442d-a5df-27082ef1f547 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Request method failure captured: Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f HTTP/1.1 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqYizRYuiRb5b3eHJtcbnh30N-R-TrLYMg3vetjhIfBf7Rje19wsI_3s5u-RAW56dxTFqm3Y7YIWtoX-naMBX84NaUJS0ORH2ALecf-x4YaybKdZwf-xL3Z5lx3OxdRGmW25saDlpOJsKpfHVmYwxnKj4RJ3g5HFiFkVXY0_Op8onU Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:34:45.284188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}] Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 8166ce98a4d94d10aa6c28e84fa93fba Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'b4df28cb-84d3-4afd-a4dc-d1033cc23e4f'} Jun 16 00:34:45.290402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. (HTTP 404) (Request-ID: req-db4b6958-a038-4814-a69d-c5ae4a7a97c5) Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.291243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 00:34:45.292332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 00:34:45.294042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-add0bd3d-28fd-442d-a5df-27082ef1f547 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Returning 404 to user: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-add0bd3d-28fd-442d-a5df-27082ef1f547 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 404 len: 109 microversion: 2.1 time: 0.086262 Jun 16 00:34:45.295225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 15/37] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:34:45 2022] DELETE /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:45.302677 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bb8a1442-927c-4cc6-b3a4-c29ac9ce40f7 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Calling method '.version_select at 0x7f2a81332a60>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:45.381596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-bb8a1442-927c-4cc6-b3a4-c29ac9ce40f7 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] HTTP exception thrown: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bb8a1442-927c-4cc6-b3a4-c29ac9ce40f7 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Request method failure captured: Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f HTTP/1.1 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqYizRYuiRb5b3eHJtcbnh30N-R-TrLYMg3vetjhIfBf7Rje19wsI_3s5u-RAW56dxTFqm3Y7YIWtoX-naMBX84NaUJS0ORH2ALecf-x4YaybKdZwf-xL3Z5lx3OxdRGmW25saDlpOJsKpfHVmYwxnKj4RJ3g5HFiFkVXY0_Op8onU Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:34:45.383788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a17db5f4c7b74c2f89cb295ce6cd8d80"}]}] Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: a17db5f4c7b74c2f89cb295ce6cd8d80 Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605212071 Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 8166ce98a4d94d10aa6c28e84fa93fba Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605212071-project Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'b4df28cb-84d3-4afd-a4dc-d1033cc23e4f'} Jun 16 00:34:45.385114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. (HTTP 404) (Request-ID: req-89796675-8b01-43ef-bb7a-06e40901d4bc) Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.385959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:34:45.387149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:34:45.388176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. Jun 16 00:34:45.389248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:34:45.390986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bb8a1442-927c-4cc6-b3a4-c29ac9ce40f7 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] Returning 404 to user: Volume b4df28cb-84d3-4afd-a4dc-d1033cc23e4f could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:34:45.391971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bb8a1442-927c-4cc6-b3a4-c29ac9ce40f7 tempest-VolumesSnapshotsTestJSON-1605212071 tempest-VolumesSnapshotsTestJSON-1605212071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f" status: 404 len: 109 microversion: 2.1 time: 0.094213 Jun 16 00:34:45.396565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 23/38] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:34:45 2022] GET /compute/v2.1/os-volumes/b4df28cb-84d3-4afd-a4dc-d1033cc23e4f => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:46.357579 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-46e9a65d-2800-4e77-a2e6-43db8f7dea44 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: .version_select at 0x7f2a811f1550>, body: {"keypair": {"name": "tempest-keypair-914888608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2vXZKV6frsH30DKzJkaQygmkUAqY2NJxWAiV9QKTfX4D2qVx0VB5XZvhq7Be1QHt0aioc//+nXZ3K+7DyAilS6aZDTMUaSekSkgq/ocg1Z1pvY+hcbYL69mMDsE7slUg=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:46.465772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-46e9a65d-2800-4e77-a2e6-43db8f7dea44 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:34:46.483725 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-46e9a65d-2800-4e77-a2e6-43db8f7dea44 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:34:46.707459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-46e9a65d-2800-4e77-a2e6-43db8f7dea44 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.708505 Jun 16 00:34:46.708467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 16/39] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:34:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:34:47.658577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-3848921", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "networks": [{"uuid": "8f4288ea-b4d4-4302-977b-e748e2c0ee47"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:47.893108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] validate_networks() for [('8f4288ea-b4d4-4302-977b-e748e2c0ee47', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:34:50.666348 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:34:50.666956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:34:50.667239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:34:50.676072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:34:50.676072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:34:50.702610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:50.708152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:50.708365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:50.711629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:50.799197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Getting quotas for project 2d9a178dbd5e430f874fa216367424dc. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:34:50.822022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Getting quotas for user 704b1cb48c7249d69ab69172d1a157b1 and project 2d9a178dbd5e430f874fa216367424dc. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:34:50.858030 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:34:50.863071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:34:51.077320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7152d5e0-5ae9-4010-90d4-f9a2ce3c9c64 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: .version_select at 0x7f2a811c25e0>, body: {"keypair": {"name": "tempest-keypair-292922988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0SSwGP3vWRzySBEHmBWHFY5tQ6Olm60T0Pg+AAZ4J3iWxTQ2I60ZOlZPlH9amckt98xIHVk4hwnHlUS8806cGJJGHfzFlMVUtdSAOaF74OlrYsYz93bhcigGzlNO6pDA=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:51.119821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-7152d5e0-5ae9-4010-90d4-f9a2ce3c9c64 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for project 494ce289f1774df0833301de8e46ae11. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:34:51.130258 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-7152d5e0-5ae9-4010-90d4-f9a2ce3c9c64 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for user 31973e5a04c14cfc90ab377eac5f4194 and project 494ce289f1774df0833301de8e46ae11. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:34:51.192425 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-64675451-414e-473d-812b-a7871cd7db89 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.977852 Jun 16 00:34:51.195919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 24/40] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:34:51.215995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-53f6ef82-8460-44df-bf21-fed1fd7269e9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:51.218831 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-53f6ef82-8460-44df-bf21-fed1fd7269e9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:51.317694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7152d5e0-5ae9-4010-90d4-f9a2ce3c9c64 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.831565 Jun 16 00:34:51.318916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 17/41] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Jun 16 00:34:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 833 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:34:51.678667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-53f6ef82-8460-44df-bf21-fed1fd7269e9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:51.693121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-53f6ef82-8460-44df-bf21-fed1fd7269e9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1212 microversion: 2.1 time: 0.490321 Jun 16 00:34:51.702429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 25/42] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:51 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1212 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:52.227155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-147341712", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffe9c59a-3096-4aef-8b2e-e3aa63722c28"}], "security_groups": [{"name": "tempest-securitygroup--374022622"}], "key_name": "tempest-keypair-914888608", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:52.661664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] validate_networks() for [('ffe9c59a-3096-4aef-8b2e-e3aa63722c28', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:34:52.711952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b4cab246-60f0-44b2-a954-de0ca2c30dfe tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:52.713166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b4cab246-60f0-44b2-a954-de0ca2c30dfe tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:52.965787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b4cab246-60f0-44b2-a954-de0ca2c30dfe tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:52.974747 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b4cab246-60f0-44b2-a954-de0ca2c30dfe tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1212 microversion: 2.1 time: 0.267633 Jun 16 00:34:52.982265 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 26/43] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:52 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1212 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:53.998662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dd0c7110-08d2-41fd-ac3e-99256efa6785 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:53.999324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dd0c7110-08d2-41fd-ac3e-99256efa6785 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:54.230360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dd0c7110-08d2-41fd-ac3e-99256efa6785 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:54.242932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dd0c7110-08d2-41fd-ac3e-99256efa6785 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1212 microversion: 2.1 time: 0.247648 Jun 16 00:34:54.244478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 27/44] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:53 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1212 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:55.463665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:34:55.464152 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:34:55.464614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:34:55.465057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:34:55.465466 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:34:55.496662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:55.497518 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:55.499079 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:55.502774 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:55.557456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:34:55.567611 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:34:55.599194 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:34:55.605046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:34:55.789440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-708201327", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:55.856042 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] validate_networks() for [('dfc603d1-751d-4be9-b4c0-08fa2224635a', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:34:55.904693 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-006b9579-5034-487f-9b24-8fc85dcb1563 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.683159 Jun 16 00:34:55.907040 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 18/45] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:34:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:34:55.918809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:55.919724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:55.943767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:55.945201 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:55.946129 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:55.946799 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:56.171312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:56.188923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9c4f2f48-8f71-4bbd-a195-61621a5d80ae tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1208 microversion: 2.1 time: 0.280077 Jun 16 00:34:56.190175 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 19/46] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:55 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1208 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:56.195204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-014d5207-d0db-4241-8a5d-85979e373823 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:56.196091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-014d5207-d0db-4241-8a5d-85979e373823 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:56.285256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-014d5207-d0db-4241-8a5d-85979e373823 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:56.303327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-014d5207-d0db-4241-8a5d-85979e373823 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1240 microversion: 2.1 time: 0.109571 Jun 16 00:34:56.308652 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 20/47] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:56 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1240 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:57.207463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:57.208180 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:57.230716 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.241128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.241128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:57.241128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:57.437713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:57.452319 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5c2be17c-070b-4fe5-a48f-cae56a155963 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1272 microversion: 2.1 time: 0.247005 Jun 16 00:34:57.455504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 21/48] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:57 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:57.479447 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d7800046-0a21-40fc-8bab-6d3a527aedb7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:57.481501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d7800046-0a21-40fc-8bab-6d3a527aedb7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:57.792454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d7800046-0a21-40fc-8bab-6d3a527aedb7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:57.806108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d7800046-0a21-40fc-8bab-6d3a527aedb7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1240 microversion: 2.1 time: 0.346663 Jun 16 00:34:57.818599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 22/49] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:57 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1240 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:58.409678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:34:58.411422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:34:58.413413 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:34:58.424861 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:34:58.425620 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:34:58.447767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.451517 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.452776 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.453569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.474290 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:58.474290 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:58.482134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.487115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.488319 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.489094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.494741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:34:58.509811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for user c9dcfb252f0d44a280b3448094883e13 and project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:34:58.559394 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:34:58.565799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:34:58.789573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:58.800478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-db43db36-94eb-41fe-894f-dfe7e01d2aa5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.707632 Jun 16 00:34:58.806738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 28/50] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:34:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:34:58.812090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-be5d5b8b-564f-42a4-9c6d-6027a0729d0a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:58.812927 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-be5d5b8b-564f-42a4-9c6d-6027a0729d0a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:58.832762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d7401bdf-c977-409d-b53a-def680f096b4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1270 microversion: 2.1 time: 0.365935 Jun 16 00:34:58.836296 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 23/51] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:58 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:34:58.855367 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:58.855985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:58.871113 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.871713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.873239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:58.873690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:58.944882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-be5d5b8b-564f-42a4-9c6d-6027a0729d0a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:58.952730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-be5d5b8b-564f-42a4-9c6d-6027a0729d0a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1221 microversion: 2.1 time: 0.144710 Jun 16 00:34:58.968795 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:58 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:59.060864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:34:59.081729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-dd35398e-48b7-4e5d-8945-716899176791 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1236 microversion: 2.1 time: 0.243885 Jun 16 00:34:59.087283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 24/53] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:58 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1236 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:34:59.145188 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1188608006", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:34:59.295395 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] validate_networks() for [('dfc603d1-751d-4be9-b4c0-08fa2224635a', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:34:59.862731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:34:59.863433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:34:59.874196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:59.875148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:34:59.876496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:34:59.879197 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:00.041032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:00.089573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9756b219-57ca-4fbb-b0b8-5781fe700a1b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1270 microversion: 2.1 time: 0.229716 Jun 16 00:35:00.107510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 25/54] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:34:59 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:00.108216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:00.108875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:00.116126 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:00.117560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:00.118885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:00.119946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:00.375441 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:00.389828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-19ea6db8-9b53-467c-af0b-fc93fa4fa44d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1300 microversion: 2.1 time: 0.287642 Jun 16 00:35:00.390620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 26/55] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:00 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:00.886767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:00.887561 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:00.887844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:00.888152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:00.888463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:00.907761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:00.910363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:00.911466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:00.912679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:00.983623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:00.996617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for user c9dcfb252f0d44a280b3448094883e13 and project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:01.037221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:01.039945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:01.125057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:01.125057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:01.140925 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.143670 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.144591 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.145096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.295603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a49acfaf-59d0-4891-aa97-bfc00b2c1585 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.155185 Jun 16 00:35:01.297136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 30/56] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:34:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:35:01.306249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0f04e810-591c-47a4-9d29-730456703c9b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:01.322371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0f04e810-591c-47a4-9d29-730456703c9b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:01.496979 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0f04e810-591c-47a4-9d29-730456703c9b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:01.504575 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0f04e810-591c-47a4-9d29-730456703c9b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1222 microversion: 2.1 time: 0.202213 Jun 16 00:35:01.507560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 31/57] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:01 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:01.521206 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:01.523969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:01.535976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.536579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.537613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:01.538295 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:01.817321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:01.851550 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-59ff7146-27d1-40ff-986c-160549445fc7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.722554 Jun 16 00:35:01.856230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 27/58] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:01 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:01.980792 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:02.004651 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e1b43031-50a8-470a-888f-7a2eaf7ce1c5 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1298 microversion: 2.1 time: 0.495766 Jun 16 00:35:02.009541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:01 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1298 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:02.176641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-763076891", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6844d01-625d-4b71-91cf-373fe3e3e7cc"}], "security_groups": [{"name": "tempest-securitygroup--456744961"}], "key_name": "tempest-keypair-292922988", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:02.523151 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ce9395bd-1004-44be-9552-5005cb0d0d37 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:02.523778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ce9395bd-1004-44be-9552-5005cb0d0d37 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:02.834373 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ce9395bd-1004-44be-9552-5005cb0d0d37 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:02.858826 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ce9395bd-1004-44be-9552-5005cb0d0d37 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1222 microversion: 2.1 time: 0.326829 Jun 16 00:35:02.860365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 33/60] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:02 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1222 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:02.875396 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:02.878488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:02.921438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.922173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:02.923996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:02.924695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:03.039964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] validate_networks() for [('a6844d01-625d-4b71-91cf-373fe3e3e7cc', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:35:03.400510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:03.411051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4af1578a-d1ee-4b20-a6d8-ebe70a576b47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.543801 Jun 16 00:35:03.414973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 34/61] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:02 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:03.423234 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:03.423884 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:03.450100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:03.450100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:03.450100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:03.450100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.317861 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.344825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4d5cdd68-8654-436d-adbc-f025a7889390 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.927407 Jun 16 00:35:04.345496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 35/62] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:03 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:04.369423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.372203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.403853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.419566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.422023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.426702 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.666404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:04.687090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6a4db561-aafc-4063-9a58-30230247db34 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1274 microversion: 2.1 time: 0.331892 Jun 16 00:35:04.687090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 36/63] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:04 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1274 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:04.710337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:04.722898 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:04.731418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.748026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.750138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.755727 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.896621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:35:04.898533 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:35:04.899440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:35:04.899971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:35:04.907884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:35:04.931133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.933702 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:04.935151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:04.936668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:05.006592 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for project 494ce289f1774df0833301de8e46ae11. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:35:05.014754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for user 31973e5a04c14cfc90ab377eac5f4194 and project 494ce289f1774df0833301de8e46ae11. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:35:05.030758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:35:05.033946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:35:05.260292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-db213868-1f53-44c6-b3b0-5d5b3837648d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.088963 Jun 16 00:35:05.264262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 28/64] 10.222.0.20 () {62 vars in 1187 bytes} [Thu Jun 16 00:35:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3095 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 00:35:05.284652 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:05.288432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:05.987544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:05.999475 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.005321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.006823 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cfb2f1bb-402a-43b2-835d-99d200f2f6b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1280 microversion: 2.20 time: 0.739222 Jun 16 00:35:06.010056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 29/65] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:05 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1280 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:06.023562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:06.031585 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:06.042532 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.043123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.044151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.044752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.180703 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.189259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-133e3ad9-a175-41cd-86d8-9550a6e56de2 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 1.506352 Jun 16 00:35:06.198130 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 37/66] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:04 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:06.213246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:06.214043 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:06.230761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.231411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.232253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.232929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.350972 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.359239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d41e3a0b-f392-4cdc-acbc-4cbd5567a6e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.159663 Jun 16 00:35:06.383015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 38/67] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:06 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:06.562022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-2cd20db4-f92a-4656-8747-7f9d851749f9 req-4a0c3ac7-bed4-45f5-9812-c84babb58942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82ca4ac6-b12b-459b-a5b3-74f98b2aa635", "tag": "432dd3b9-53d3-41b9-b199-4ccdb65e8510"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:06.601787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2cd20db4-f92a-4656-8747-7f9d851749f9 req-4a0c3ac7-bed4-45f5-9812-c84babb58942 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.604193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2cd20db4-f92a-4656-8747-7f9d851749f9 req-4a0c3ac7-bed4-45f5-9812-c84babb58942 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.644805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-2cd20db4-f92a-4656-8747-7f9d851749f9 req-4a0c3ac7-bed4-45f5-9812-c84babb58942 service nova] Creating event network-changed:432dd3b9-53d3-41b9-b199-4ccdb65e8510 for instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 on hv-cinder-80382 Jun 16 00:35:06.645521 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2cd20db4-f92a-4656-8747-7f9d851749f9 req-4a0c3ac7-bed4-45f5-9812-c84babb58942 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:35:06.646631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.647074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.648116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:06.648585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:06.658013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.compute.rpcapi [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:35:06.659887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] Releasing lock "compute-rpcapi-router" {{(pid=124721) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:35:06.684553 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6d2ab854-56e7-47c7-8b75-fa91ee9dab15 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309168 Jun 16 00:35:06.685801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 39/68] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:06.708406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:06.719113 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f2d9657a-7d4b-46b0-a24c-adf5fef98b91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.707591 Jun 16 00:35:06.729179 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 30/69] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:06 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:07.029038 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.029883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.153516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.162835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.165041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.166568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6304b76b-9ed2-49db-bf48-448313fb7f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1280 microversion: 2.20 time: 0.142131 Jun 16 00:35:07.167650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 40/70] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:07.216087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.216750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.225571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.226035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.226863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.229019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.395116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.396580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.403026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.409072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.409072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.409072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.540844 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.548406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.552480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3337ad03-d387-4731-9a8f-411ec1b98803 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.339552 Jun 16 00:35:07.552480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 31/71] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:07.566586 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-896c3030-b8eb-4148-be75-83137e633668 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.180672 Jun 16 00:35:07.567173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 41/72] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:07.761174 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:07.761174 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:07.768618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.769332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.771210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.772371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.822265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-00a4df9c-ff88-4380-88b7-49f6f0dc6a5b req-c13884b3-eae9-4e08-acad-d108f74bcd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0", "tag": "29f5f1c3-c98e-4a58-85e1-442189e98eee"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:07.842377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-00a4df9c-ff88-4380-88b7-49f6f0dc6a5b req-c13884b3-eae9-4e08-acad-d108f74bcd69 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.847087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-00a4df9c-ff88-4380-88b7-49f6f0dc6a5b req-c13884b3-eae9-4e08-acad-d108f74bcd69 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.888436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-00a4df9c-ff88-4380-88b7-49f6f0dc6a5b req-c13884b3-eae9-4e08-acad-d108f74bcd69 service nova] Creating event network-changed:29f5f1c3-c98e-4a58-85e1-442189e98eee for instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 on hv-cinder-80382 Jun 16 00:35:07.889176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-00a4df9c-ff88-4380-88b7-49f6f0dc6a5b req-c13884b3-eae9-4e08-acad-d108f74bcd69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 00:35:07.890358 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.890879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.891729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:07.892238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:07.902080 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.compute.rpcapi [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 00:35:07.903221 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] Releasing lock "compute-rpcapi-router" {{(pid=124722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 00:35:07.920437 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7fb26bb2-8da2-4ede-be0c-37ec32d395ed None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260669 Jun 16 00:35:07.923982 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 32/73] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:07.975337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:07.982987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-818d3292-72eb-4d70-b8e1-11ac0e831633 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.235198 Jun 16 00:35:07.988234 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 42/74] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:07 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:08.185917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:08.193480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:08.202508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.203044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.203842 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.204283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.296105 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.309650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.309650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.309650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-55ae63f2-c8ed-4d0a-a032-f9f43c0ddba4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1284 microversion: 2.20 time: 0.127852 Jun 16 00:35:08.313262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 33/75] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:08 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:08.569049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:08.569663 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:08.575816 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.576324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.577201 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.577837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.584173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:08.584864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:08.595089 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.597975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.599146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:08.599238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:08.666149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.678937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8a29a495-d0e2-4c8a-a64f-f84b934c4fad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.099365 Jun 16 00:35:08.680025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 34/76] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:08 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:08.768958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:08.778641 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b5536ef6-f3be-4ce7-8f27-4ddbd4d4fb54 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.213756 Jun 16 00:35:08.779351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 43/77] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:08 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:09.000760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.001366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.009872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.010563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.011658 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.012444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.172626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.180974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-74ad49e0-9b40-4913-868e-be4c139343a7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.184026 Jun 16 00:35:09.181547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 35/78] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:08 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:09.331290 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.331956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.343243 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.344082 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.347838 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.355454 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.463640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.472514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.487649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.488433 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f5a76c4b-06ee-4da2-a8cf-6a313fe66860 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1284 microversion: 2.20 time: 0.161007 Jun 16 00:35:09.489962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 44/79] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:09 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:09.698448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.699116 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.703324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:09.714586 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.715488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.716285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.716759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.789610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:09.797820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b7da46f4-ae56-461d-960b-fc499d223de5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.104046 Jun 16 00:35:09.798611 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 36/80] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:09 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:09.804336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:09.804336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:09.807900 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:09.812055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.817245 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.818053 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:09.818490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:09.992011 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.000135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a06cb28b-2300-4c6d-b841-0d6d231c8c7c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.204526 Jun 16 00:35:10.011827 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 45/81] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:09 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:10.208044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:10.208044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:10.208044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.208683 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.210977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.211743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.508348 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:10.509765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:10.520755 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.521448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.525110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.525110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.605782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.618417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.620197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:10.622206 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-31ca2fb6-67a9-4d8b-9fb4-2ee9196b8119 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1284 microversion: 2.20 time: 0.118393 Jun 16 00:35:10.623305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 46/82] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:10 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:35:10.817018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:10.817753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:10.825707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.829449 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:10.830494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:10.831105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.034562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.051414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dff626e2-f8af-47af-9aa7-54e184f7fd1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.236035 Jun 16 00:35:11.055441 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 47/83] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:10 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:11.085131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:11.088947 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:11.110538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.112207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.113357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.113805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.174801 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.190969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-586100d5-d3f7-4e68-a0c1-c9f6fe5ab723 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.995073 Jun 16 00:35:11.192476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 37/84] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:10 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:11.458600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.475868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ec65e3c1-da39-49ee-beea-68b9b87cbc68 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.418068 Jun 16 00:35:11.476757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 48/85] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:11 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:11.649330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:11.649845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:11.677636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.693583 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.698096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:11.698805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:11.881517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.898464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.899999 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:11.901186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4e541b5a-9d9c-4696-a7b1-2255f0869fbc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1332 microversion: 2.20 time: 0.261094 Jun 16 00:35:11.917092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 38/86] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:11 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1332 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:12.097609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.104990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:12.141894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.142360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.148579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.149300 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.210370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.211170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:12.249571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.250806 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.252563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.253261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.289373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:12.361026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.364878 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:12.374921 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b0764469-13de-4531-a71d-13323b371001 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1280 microversion: 2.1 time: 0.307839 Jun 16 00:35:12.389199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 49/87] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:12.494016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.494893 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:12.503981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.507611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.507611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:12.507611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:12.965598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:12.984551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-13fd2d05-1e7c-4b56-b82d-af9654bb912d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.494414 Jun 16 00:35:12.985292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 50/88] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:12.985292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:12.985292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:13.014403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.014403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.014403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.014403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.129242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:13.141814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:13.144055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:13.156102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-56c5a721-f229-4b64-9e83-4ca05459b73f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1340 microversion: 2.20 time: 0.169517 Jun 16 00:35:13.156971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 51/89] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:13.317608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:13.345881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1014ab44-dc65-447f-8c16-96211c699a85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 1.140477 Jun 16 00:35:13.371236 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 39/90] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:12 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:13.396435 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:13.397013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:13.412544 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.417283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.421218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.421744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.802019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-d6d56807-f1d0-4f8a-a089-0391736850ee req-0224df75-322a-4669-9bad-084f712d5122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99af546-f8bc-4967-b251-7e486805f7f7", "tag": "ef72a429-cef2-411d-909d-196a4e3ab735"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:13.827098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-d6d56807-f1d0-4f8a-a089-0391736850ee req-0224df75-322a-4669-9bad-084f712d5122 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:13.831682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-d6d56807-f1d0-4f8a-a089-0391736850ee req-0224df75-322a-4669-9bad-084f712d5122 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:13.902056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-d6d56807-f1d0-4f8a-a089-0391736850ee req-0224df75-322a-4669-9bad-084f712d5122 service nova] Creating event network-changed:ef72a429-cef2-411d-909d-196a4e3ab735 for instance b99af546-f8bc-4967-b251-7e486805f7f7 on hv-cinder-80382 Jun 16 00:35:13.934174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-d6d56807-f1d0-4f8a-a089-0391736850ee req-0224df75-322a-4669-9bad-084f712d5122 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117865 Jun 16 00:35:13.935820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 40/91] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:14.014724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:14.019030 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:14.034254 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.035298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.037107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.038177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.255040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.268904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-386c7a4b-cb5b-473f-a4a2-cf813049c029 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.878300 Jun 16 00:35:14.269946 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 52/92] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:13 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:14.277917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:14.282990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:14.299518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.300248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.301271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.301907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.436485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.461430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.470667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.470667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a129b041-4e65-4faa-b1db-f98100975647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1338 microversion: 2.20 time: 0.198551 Jun 16 00:35:14.475087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 53/93] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:14 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:14.483110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:14.485241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:14.493777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.496824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.496824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:14.496824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:14.700048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:14.711276 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8684531c-a442-4bf8-84eb-ef819441f153 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.233095 Jun 16 00:35:14.711952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 54/94] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:14 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:15.049373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.059014 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-959e3509-ba4e-46e0-9ed5-04ea95b90c20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 1.059729 Jun 16 00:35:15.106450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 41/95] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:13 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:15.286731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.287897 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.294475 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.294920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.296601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.297062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.490410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.491039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.500801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.503674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.504119 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.505037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.505487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.511893 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3762f442-c408-4dd2-9597-ff024e6407cc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.229479 Jun 16 00:35:15.515813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 55/96] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:15.615662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.623718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.627265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.629654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8f672c58-051d-4e79-9ca9-83041c2a9138 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1338 microversion: 2.20 time: 0.144059 Jun 16 00:35:15.629654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 42/97] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1338 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:15.729147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:15.730103 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:15.736313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.736914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.737992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:15.738662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:15.896938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:15.908924 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dd055be2-8d75-4d76-a3b6-1c0a3c4ea5de tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.184369 Jun 16 00:35:15.923965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 56/98] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:15 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:16.124718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.125351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.129290 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=26 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:16.146068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.146524 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.147826 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.156342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.480413 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.490376 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-72ce6b41-4e98-4dfe-a72f-b3a50e585754 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.370275 Jun 16 00:35:16.490968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 43/99] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:16.532318 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.535171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.539619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.540067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.540996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.541439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.654968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.655596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.657773 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=8 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:16.666882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.667588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.668758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.669407 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.785681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:16.800253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c2911dcc-0cbd-47f4-8dd7-168b94e0ee1e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.265779 Jun 16 00:35:16.800253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 57/100] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:16.856807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-a02cd610-ddd4-474e-ba7f-59062ff8c393 req-175a25ba-bcc3-4b7c-9a85-fafcd9576765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76508475-0af3-48d7-8f12-9ad3686d77f0", "tag": "ba7aa17f-4993-4f62-8ae9-acb5a856dcd4"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:16.872509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a02cd610-ddd4-474e-ba7f-59062ff8c393 req-175a25ba-bcc3-4b7c-9a85-fafcd9576765 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.873365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a02cd610-ddd4-474e-ba7f-59062ff8c393 req-175a25ba-bcc3-4b7c-9a85-fafcd9576765 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.885882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-a02cd610-ddd4-474e-ba7f-59062ff8c393 req-175a25ba-bcc3-4b7c-9a85-fafcd9576765 service nova] Creating event network-changed:ba7aa17f-4993-4f62-8ae9-acb5a856dcd4 for instance 76508475-0af3-48d7-8f12-9ad3686d77f0 on hv-cinder-80382 Jun 16 00:35:16.892005 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-a02cd610-ddd4-474e-ba7f-59062ff8c393 req-175a25ba-bcc3-4b7c-9a85-fafcd9576765 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038804 Jun 16 00:35:16.894490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 58/101] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:16.941420 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:16.942910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:16.950887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.951338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:16.952122 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:16.952606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.037057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.059006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.063188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.075729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a8905329-c90d-48bd-b5ee-8646ffd6ab7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.418787 Jun 16 00:35:17.077275 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 44/102] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:17.157800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=32 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:17.224961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.235970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4073b9d6-85d9-4cb9-8603-0c9288b6d52b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.313647 Jun 16 00:35:17.237079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 59/103] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:16 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:17.506631 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:17.507830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:17.519400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.519859 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.520712 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.521225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.657054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:17.666907 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-64debd36-568e-42b3-b4c1-ff29ad740eb8 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.164062 Jun 16 00:35:17.672953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 45/104] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:17 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:17.813487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:17.816410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:17.831317 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.832127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:17.833429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:17.834701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.026049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.034272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fe747a04-f630-4abb-9a4c-bc12554d2cec tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.226667 Jun 16 00:35:18.034871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 60/105] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:17 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:18.094743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.096454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.098642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=6 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:18.104174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.106863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.106863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.106863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.253235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.254118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.260566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.266262 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.266262 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.266262 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.367990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.376353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.378266 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.379387 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-78a10996-b47a-4e29-9421-de4c443b1bcb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.288760 Jun 16 00:35:18.379949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 46/106] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:18.440853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:18.470438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-41fe63ab-676b-4a12-a805-5cd9c77e2e16 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.221372 Jun 16 00:35:18.474386 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 61/107] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:18.683355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:18.683970 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:18.696605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.697343 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:18.702535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:18.703749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.054426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:19.055984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:19.062874 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.063499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.065292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.068904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.160771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.182365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-29751a60-5d86-49ab-bf67-34abc9a4fd78 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.502857 Jun 16 00:35:19.183470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 47/108] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:18 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:19.228255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.235821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e129a02d-bae6-4612-a770-4f0a35180922 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.188277 Jun 16 00:35:19.237041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 62/109] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:19 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:19.397280 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:19.398101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:19.408018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.408018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.408018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.408018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.493681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:19.494565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:19.507822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.508642 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.510416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:19.510669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:19.703772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:19.712437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e51e704f-ddcb-442f-ba8b-45172d6d6c5c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.222522 Jun 16 00:35:19.721811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 63/110] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:19 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:20.026107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-578c9140-4c86-4ebf-af63-7e8e76f0bc1e req-1bad8f0f-d602-4613-b1e3-f7cee70c85ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:20.050025 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-578c9140-4c86-4ebf-af63-7e8e76f0bc1e req-1bad8f0f-d602-4613-b1e3-f7cee70c85ec service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.050505 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-578c9140-4c86-4ebf-af63-7e8e76f0bc1e req-1bad8f0f-d602-4613-b1e3-f7cee70c85ec service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.095426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-578c9140-4c86-4ebf-af63-7e8e76f0bc1e req-1bad8f0f-d602-4613-b1e3-f7cee70c85ec service nova] Creating event network-changed:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:35:20.108803 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-578c9140-4c86-4ebf-af63-7e8e76f0bc1e req-1bad8f0f-d602-4613-b1e3-f7cee70c85ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094604 Jun 16 00:35:20.110169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 64/111] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:20.111784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.120617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.122127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.123232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6972ccc7-2492-41b0-b87d-35740c279cc9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.729894 Jun 16 00:35:20.124003 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 48/112] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:19 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:20.205415 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:20.206113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:20.216702 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.218951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.221336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.222939 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.254019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:20.254570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:20.274746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.274746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.274746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.274746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.426999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.435516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a1f838ec-f0ac-4e4f-afcf-5441bd472674 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.234336 Jun 16 00:35:20.436593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 65/113] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:20 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:20.585423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.594092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1811a0a2-3229-47b8-a631-f6d0bce99c6f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.344704 Jun 16 00:35:20.594675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 49/114] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:20 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:20.741146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:20.741775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:20.753505 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.753967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.754740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:20.755180 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:20.898378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:20.920696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7187147b-677c-4080-b4a4-8dbff3bb5fcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.179876 Jun 16 00:35:20.920696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 66/115] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:20 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:21.141847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.143017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.148997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.149439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.150190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.150619 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.307222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.316451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.318149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.319424 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-46b9ab17-9b1d-4415-b803-bb605305cea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.181575 Jun 16 00:35:21.320109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 50/116] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:21.456087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.456951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.464444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.469965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.469965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.469965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.552472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-6b7fa3cf-b86e-40b2-b7a7-9843604cdcb5 req-232ed4c2-7fee-4c1d-8f1f-5c48c8b214c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ca4ac6-b12b-459b-a5b3-74f98b2aa635", "name": "network-vif-plugged", "status": "completed", "tag": "432dd3b9-53d3-41b9-b199-4ccdb65e8510"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:21.560830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-6b7fa3cf-b86e-40b2-b7a7-9843604cdcb5 req-232ed4c2-7fee-4c1d-8f1f-5c48c8b214c6 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.561494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-6b7fa3cf-b86e-40b2-b7a7-9843604cdcb5 req-232ed4c2-7fee-4c1d-8f1f-5c48c8b214c6 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.579214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-6b7fa3cf-b86e-40b2-b7a7-9843604cdcb5 req-232ed4c2-7fee-4c1d-8f1f-5c48c8b214c6 service nova] Creating event network-vif-plugged:432dd3b9-53d3-41b9-b199-4ccdb65e8510 for instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 on hv-cinder-80382 Jun 16 00:35:21.584237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-6b7fa3cf-b86e-40b2-b7a7-9843604cdcb5 req-232ed4c2-7fee-4c1d-8f1f-5c48c8b214c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094864 Jun 16 00:35:21.584910 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 51/117] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:21.613678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.614439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.621966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.623856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.623856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.623856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.631359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.634919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:21.640074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3bb945d5-0188-49d2-929b-80124f1431ec tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.190214 Jun 16 00:35:21.641824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 67/118] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:21.895200 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:21.903857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ff44f81f-c6e9-4108-b089-8fda1ef324f9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.296103 Jun 16 00:35:21.907186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 52/119] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:21.946637 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:21.947254 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:21.962367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.962367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:21.962367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:21.962367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.107533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.115015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e5bc1a39-f856-45d4-b2c7-d927cb02ab85 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.183498 Jun 16 00:35:22.116214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 68/120] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:21 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:22.349668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.350828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.360322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.362433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.363799 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.365120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.516268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.527947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.529996 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.531376 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ef52f032-d20a-4c05-b788-71a67f3a678d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.195127 Jun 16 00:35:22.532398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 53/121] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:22.658906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.659543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.665796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.666337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.667079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.667508 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.822980 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:22.830915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8252e341-c56c-45be-8d34-0b619e27bd47 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.176197 Jun 16 00:35:22.839985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 69/122] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:22.923058 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:22.923809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:22.937348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.938316 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:22.940808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:22.941617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.132911 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.133521 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.144698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.145347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.146489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.147121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.223408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.232067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-555fa513-2746-447a-b816-19f8c40a644a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.313436 Jun 16 00:35:23.244685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 54/123] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:22 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:23.312653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.321834 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-77b57718-a548-4fe5-91bb-365fe6f699f7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.192618 Jun 16 00:35:23.322516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 70/124] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:23.548780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.549331 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.555365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.555815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.556632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.557042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.602286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-178ed752-3404-466b-8009-48717597a441 req-2c1928ee-79b4-4134-b613-f9cd6fcfa264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0", "name": "network-vif-plugged", "status": "completed", "tag": "29f5f1c3-c98e-4a58-85e1-442189e98eee"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:23.611464 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-178ed752-3404-466b-8009-48717597a441 req-2c1928ee-79b4-4134-b613-f9cd6fcfa264 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.612095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-178ed752-3404-466b-8009-48717597a441 req-2c1928ee-79b4-4134-b613-f9cd6fcfa264 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.629509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-178ed752-3404-466b-8009-48717597a441 req-2c1928ee-79b4-4134-b613-f9cd6fcfa264 service nova] Creating event network-vif-plugged:29f5f1c3-c98e-4a58-85e1-442189e98eee for instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 on hv-cinder-80382 Jun 16 00:35:23.634654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-178ed752-3404-466b-8009-48717597a441 req-2c1928ee-79b4-4134-b613-f9cd6fcfa264 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036369 Jun 16 00:35:23.635235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 71/125] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:23.706622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.714913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.716512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:23.717723 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a3ec7998-ddf0-40cb-9e91-3a1e96616c2e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.172894 Jun 16 00:35:23.718721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 55/126] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:23.848477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:23.849397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:23.855591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.856102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:23.856970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:23.857602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.040393 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.047801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5a54fab4-5730-4034-bf3c-b9baf187c182 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.204426 Jun 16 00:35:24.048368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 72/127] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:23 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:24.251293 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.252821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.261245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.261896 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.263026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.263712 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.339476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.340003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.346016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.346459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.347210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.347640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.411472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.424886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-80d84e24-c4f6-4a66-85c7-144b56d6408d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.174155 Jun 16 00:35:24.428812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 56/128] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:24.549231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.556049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5962cdf3-1951-467e-8002-583d6f687b89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.220577 Jun 16 00:35:24.556813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 73/129] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:24.735801 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:24.737134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:24.743252 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.743711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.744484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:24.744946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:24.750616 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:24.888731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.905168 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.907176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:24.910237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a5ab09ac-8fb9-45b4-8c8c-7b7a85168e88 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.178771 Jun 16 00:35:24.912255 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 57/130] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:24 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:25.066811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:25.067431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:25.075866 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.076550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.077476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.078289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.249297 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.256780 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-60d16cdf-e594-4414-bef8-2f2436961b0d tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1312 microversion: 2.1 time: 0.196056 Jun 16 00:35:25.257339 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 74/131] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:25 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:25.435462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:25.436082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:25.445054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.445515 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.446311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.446759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.573711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:25.574316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:25.583547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.584009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.584815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.585256 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.667479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.678364 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0314ccd0-9dd8-423c-8dc4-24164776ecdf tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.246478 Jun 16 00:35:25.679454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 58/132] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:25 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:25.685787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76508475-0af3-48d7-8f12-9ad3686d77f0", "name": "network-vif-plugged", "status": "completed", "tag": "ba7aa17f-4993-4f62-8ae9-acb5a856dcd4"}, {"server_uuid": "b99af546-f8bc-4967-b251-7e486805f7f7", "name": "network-vif-plugged", "status": "completed", "tag": "ef72a429-cef2-411d-909d-196a4e3ab735"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:25.698346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.698934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.713422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] Creating event network-vif-plugged:ba7aa17f-4993-4f62-8ae9-acb5a856dcd4 for instance 76508475-0af3-48d7-8f12-9ad3686d77f0 on hv-cinder-80382 Jun 16 00:35:25.713921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] Creating event network-vif-plugged:ef72a429-cef2-411d-909d-196a4e3ab735 for instance b99af546-f8bc-4967-b251-7e486805f7f7 on hv-cinder-80382 Jun 16 00:35:25.723913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-8aaa2564-7cfe-4a8a-a850-3af9319f805f req-4b403248-a2f6-46c6-b7f9-cbd4aeb884a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042908 Jun 16 00:35:25.724734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 59/133] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:25.782571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:25.790783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1ae41c7c-a24a-4d50-b37d-a64d1abe7c73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1365 microversion: 2.1 time: 0.220760 Jun 16 00:35:25.791450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 75/134] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:25 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:25.930271 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:25.930959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:25.937478 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.937949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:25.938979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:25.939442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.097978 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.111947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.114502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.116334 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-74f089b6-0cab-4dfa-98f3-c94b6ec1ee6b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.190452 Jun 16 00:35:26.117302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 60/135] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:25 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:26.276036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:26.277032 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:26.284091 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.284555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.285332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.285771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.444896 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.462758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-af6ab773-6eaa-4853-9248-702ed4c5b6eb tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1498 microversion: 2.1 time: 0.184469 Jun 16 00:35:26.467497 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 76/136] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:26 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1498 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:26.697666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:26.698285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:26.708161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.708653 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.716436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.716436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.810542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:26.812253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:26.829602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.833485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.834538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:26.847311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:26.967873 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:26.980411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5f46b75e-bc03-4e30-be80-78e0289de6c7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.285244 Jun 16 00:35:26.980411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 61/137] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:26 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:27.097892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.105630 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fe84006a-5f36-415e-9e3b-1c0b65251707 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1556 microversion: 2.1 time: 0.300931 Jun 16 00:35:27.106408 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 77/138] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:26 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1556 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:27.124281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:27.125484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:27.136417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.137181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.138259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.138874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.156777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:27.160334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:27.167217 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.167911 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.169904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:27.171993 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:27.274748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c603a3e5-3f13-49fa-abe0-24e3ad94e062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155637 Jun 16 00:35:27.281629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 62/139] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:35:27 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:27.380296 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.396391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.410111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:27.412508 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-24f25db1-8380-469b-95a9-adea4a93a3f3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.266850 Jun 16 00:35:27.416423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 78/140] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:27 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:27.993633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:27.994253 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:28.000574 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.006523 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.007567 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.008069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.407090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec177599-d50a-49aa-a713-f0c1c69de176"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:28.414079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:28.420550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.421844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.424158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.424831 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.448960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.463242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-792ad74e-1b18-4196-a621-41261ea7b355 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1322 microversion: 2.1 time: 0.470739 Jun 16 00:35:28.463242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 63/141] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:27 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:28.474664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:28.475312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:28.481923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.482385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.483174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.483598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.773350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.784403 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.787222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:28.791840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-73e842ae-3aa8-46d6-b874-7b8d4f13e6bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.328885 Jun 16 00:35:28.794785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 64/142] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:28 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:28.898503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-3b684df7-3a09-4b13-b542-3890f7d585d7 req-f2fee3f2-ed86-449c-8a49-3cfe8ca2561b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "name": "network-vif-plugged", "status": "completed", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:28.909432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3b684df7-3a09-4b13-b542-3890f7d585d7 req-f2fee3f2-ed86-449c-8a49-3cfe8ca2561b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:28.909943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3b684df7-3a09-4b13-b542-3890f7d585d7 req-f2fee3f2-ed86-449c-8a49-3cfe8ca2561b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:28.922099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-3b684df7-3a09-4b13-b542-3890f7d585d7 req-f2fee3f2-ed86-449c-8a49-3cfe8ca2561b service nova] Creating event network-vif-plugged:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:35:28.927622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-3b684df7-3a09-4b13-b542-3890f7d585d7 req-f2fee3f2-ed86-449c-8a49-3cfe8ca2561b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033053 Jun 16 00:35:28.928765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 65/143] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:29.191620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-be956c19-b456-490d-b25f-928ab9e3ceb7 req-140e6760-cf7d-46f5-99ea-ec9d7c9a8d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0", "tag": "29f5f1c3-c98e-4a58-85e1-442189e98eee"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:29.201177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-be956c19-b456-490d-b25f-928ab9e3ceb7 req-140e6760-cf7d-46f5-99ea-ec9d7c9a8d47 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:29.201628 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-be956c19-b456-490d-b25f-928ab9e3ceb7 req-140e6760-cf7d-46f5-99ea-ec9d7c9a8d47 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:29.212902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-be956c19-b456-490d-b25f-928ab9e3ceb7 req-140e6760-cf7d-46f5-99ea-ec9d7c9a8d47 service nova] Creating event network-changed:29f5f1c3-c98e-4a58-85e1-442189e98eee for instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 on hv-cinder-80382 Jun 16 00:35:29.217650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-be956c19-b456-490d-b25f-928ab9e3ceb7 req-140e6760-cf7d-46f5-99ea-ec9d7c9a8d47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030849 Jun 16 00:35:29.218237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 66/144] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:29.478213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:29.480665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:29.488578 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:29.489346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:29.490767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:29.491568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:29.739034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:29.749875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a975ead6-6c2d-43f5-b1d9-dd7e58cc6af7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1516 microversion: 2.1 time: 0.275866 Jun 16 00:35:29.750806 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 67/145] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:29 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:29.768315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:29.769962 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:29.791029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:29.791728 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:29.797184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:29.799171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:29.853306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'flavor' on Instance uuid 76508475-0af3-48d7-8f12-9ad3686d77f0 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:35:30.252572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7ea53915-f72f-4f73-b8aa-17747257aaa9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0/action" status: 200 len: 32 microversion: 2.1 time: 0.486708 Jun 16 00:35:30.257213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 68/146] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:35:29 2022] POST /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 00:35:30.273103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:30.274121 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:30.291365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.293450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.295991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.298002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.529321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-855478b4-19f4-4a33-b783-39b527247dc6 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "POST /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.125381 Jun 16 00:35:30.534875 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 79/147] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:35:28 2022] POST /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635/os-volume_attachments => generated 194 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:30.555465 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:30.559871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:30.579209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.585685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.590115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:30.592011 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:30.685284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.707700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.707700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.708127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-11b672b8-9c4d-47ee-a694-babf538f514e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.449555 Jun 16 00:35:30.708710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 69/148] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:30 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:30.952397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:30.961354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-adc1e9a7-2db6-47c9-b258-c597d91341b5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.424724 Jun 16 00:35:30.962224 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 80/149] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:30 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:31.726336 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:31.727047 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:31.732913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.733368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:31.734131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.734565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:31.872068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.880097 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.881609 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:31.882684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bc9bccdc-4b57-4654-97c9-61f04a04feeb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.160313 Jun 16 00:35:31.883232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 70/150] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:31 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:31.981407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:31.982008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:31.989313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.989746 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:31.990500 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:31.990937 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:32.169043 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:32.177855 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-806b059a-db97-49f5-8139-b1e2933d381f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.200238 Jun 16 00:35:32.178498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 81/151] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:31 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:32.900324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:32.900952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:32.907014 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:32.907471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:32.908805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:32.909236 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:33.040114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.047848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.049366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.050500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f1c51b42-c38b-4325-9eb3-b96eb62dfb4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.154108 Jun 16 00:35:33.051048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 71/152] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:32 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:33.196265 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:33.197000 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:33.213107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:33.213107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:33.213107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:33.213366 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:33.423403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:33.432122 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f6ba3808-6798-4bd1-8e56-5107b6aeaa7f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.240237 Jun 16 00:35:33.432743 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 82/153] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:33 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:34.068626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:34.069352 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:34.075596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.076044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.076857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.077303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.229950 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.242870 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.244832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.246113 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ba5b81d8-8b8d-4f9d-8db0-3e97340ad301 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.181429 Jun 16 00:35:34.256569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 72/154] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:34 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:34.451975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:34.452682 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:34.462164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.465342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.466350 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:34.466989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:34.646392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:34.650558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:34.658842 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4e28775e-26f9-4028-8dfc-f35f50ebd555 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.211557 Jun 16 00:35:34.668255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 83/155] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:34 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:35.264044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.264729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.270759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.271439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.272367 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.272837 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.401596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:35.411531 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:35.413385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:35.414791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a7e83925-1ef9-4eaa-be4e-10ebed2cd1d0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.155424 Jun 16 00:35:35.415714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 73/156] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:35 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:35.675722 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:35.676329 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:35.683594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.684085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.684883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:35.685324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:35.810197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:35.817824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a3c33fc1-c347-497e-8c17-437fd8ee30e8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.146582 Jun 16 00:35:35.818389 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 84/157] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:35 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:36.433560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:36.434150 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:36.441000 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.441446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.442186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.442615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.446699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:36.574585 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.582613 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.584135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:36.585324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-adf0a9b2-6135-4bdf-a372-25c5f5c97d05 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.155612 Jun 16 00:35:36.586062 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 74/158] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:36 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:36.835100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:36.835711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:36.843032 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.843488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:36.844257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:36.844728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.027148 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.034990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-30fa7b3d-18d0-4cdd-838b-c21da2f83512 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.204203 Jun 16 00:35:37.035487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 85/159] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:36 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:37.608988 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:37.608988 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:37.612748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.613205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.613965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:37.614396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:37.742997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.750935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.753421 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:37.754525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c27d5baa-70c8-40b1-a34f-bbc5b6949995 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1405 microversion: 2.20 time: 0.153534 Jun 16 00:35:37.755075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 75/160] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:37 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:38.053156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.053801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.061149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.061527 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.063486 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.063486 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.209403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.217290 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6bbd7972-00dc-49b4-96e7-0d59fa211583 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.168860 Jun 16 00:35:38.221264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 86/161] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:38.774225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.774824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:38.797933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.797933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.797933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:38.797933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:38.959579 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.967872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.969561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:38.970743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6a64bd30-a6a7-4b45-95a0-91833efe3095 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1597 microversion: 2.20 time: 0.200558 Jun 16 00:35:38.971304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 76/162] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1597 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:35:38.996582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:38.997149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.003720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.004275 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.005127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.005774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.148144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0519f946-d768-4825-b26d-49af3b28a562 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.155693 Jun 16 00:35:39.149319 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 87/163] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Jun 16 00:35:38 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:35:39.234678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:39.235441 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:39.242532 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.243347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.244371 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:39.244922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:39.580901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:39.589035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-79eb2b04-46d5-427b-9d35-733307606875 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.358108 Jun 16 00:35:39.589610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 77/164] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:39 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:40.363461 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-2cd757c7-a941-495c-b63c-01e4b46b079d req-f4153a30-5b19-4bcc-ab95-69fc0cc33074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:40.373626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2cd757c7-a941-495c-b63c-01e4b46b079d req-f4153a30-5b19-4bcc-ab95-69fc0cc33074 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.374356 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2cd757c7-a941-495c-b63c-01e4b46b079d req-f4153a30-5b19-4bcc-ab95-69fc0cc33074 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.391700 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-2cd757c7-a941-495c-b63c-01e4b46b079d req-f4153a30-5b19-4bcc-ab95-69fc0cc33074 service nova] Creating event network-changed:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:35:40.398171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-2cd757c7-a941-495c-b63c-01e4b46b079d req-f4153a30-5b19-4bcc-ab95-69fc0cc33074 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039026 Jun 16 00:35:40.404221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 88/165] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:35:40.605746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:40.606781 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:40.613243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.613690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.614446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:40.615054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:40.758306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:40.765786 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f98a9540-9f5d-4c94-a5c1-c96dc1a94083 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.163865 Jun 16 00:35:40.766372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 78/166] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:40 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:41.784848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:41.785549 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:41.787560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=87 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:41.793373 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.793827 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.794596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:41.795415 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:41.928155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:41.935565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-41269d36-6a6d-43da-b5f4-99e85d5722fd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.156079 Jun 16 00:35:41.936126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 89/167] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:41 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:42.952835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:42.953437 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:42.955328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=85 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:42.960773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.961388 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:42.962176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:42.962607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:43.270884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:43.278396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-df364c1c-26ac-49bb-9b8b-7ba601f9a756 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.329539 Jun 16 00:35:43.279148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 79/168] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:42 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:44.294988 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:44.295598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:44.304844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.305301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.306078 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:44.306551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:44.443728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:44.451979 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-03a03daa-f776-482f-803f-cd75c8613d4b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.160837 Jun 16 00:35:44.452551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 90/169] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:44 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:45.469122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:45.469734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:45.475858 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.476311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.477102 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:45.477547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:45.608339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:45.616228 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d7c00cbf-fc1a-45ec-a977-c1f9b436de2f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.150998 Jun 16 00:35:45.616822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 80/170] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:45 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:46.633613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:46.634221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:46.640849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.641373 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.642129 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:46.642565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:46.769891 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:46.777571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cc2f0adf-8d6c-45c9-a257-74e4b8d5a624 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.147895 Jun 16 00:35:46.778135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 91/171] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:46 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:47.794599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:47.795160 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:47.801731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.802178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:47.802928 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:47.803359 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:48.152808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:48.160399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3fb5f626-84e1-4867-86fb-0dc2ad3238ce tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.369711 Jun 16 00:35:48.161035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 81/172] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:47 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:49.177475 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:49.178144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:49.185863 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.186295 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:49.187062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:49.187562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:49.337087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:49.345424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4329da56-6d08-4524-9fa3-7d82a383afe8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.171046 Jun 16 00:35:49.345424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 92/173] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:49 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:50.361605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:50.362841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:50.368987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.369440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.370190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.370621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.514874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:50.522787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-94b34819-9997-4914-87c3-9af4307d0d36 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.165031 Jun 16 00:35:50.523443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 82/174] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:50 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:50.566062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:50.566608 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:50.573336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.573957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.575246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.576156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.614300 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:35:50.917106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e38fa795-edc1-4f6a-aeac-d941ddc075b7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 204 len: 0 microversion: 2.1 time: 0.354740 Jun 16 00:35:50.917915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 93/175] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:35:50 2022] DELETE /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:35:50.925894 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:50.926553 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:50.932403 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.932906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:50.933666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:50.934101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.063462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:51.072160 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d8f49989-56d5-4413-a28f-3858942e26e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1550 microversion: 2.1 time: 0.150131 Jun 16 00:35:51.074435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 83/176] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:50 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:51.539705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:51.540406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:51.546499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.546955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.547721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:51.548155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:51.701639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:51.710015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e24ba60d-41ba-491e-b7ea-fae9653fc9d2 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.174444 Jun 16 00:35:51.710580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 94/177] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:51 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:52.089369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:52.089987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:52.096051 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.097529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.098289 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.098733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.228920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.237350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6e88bac1-29a2-4462-91a3-d2fc53d6f032 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1550 microversion: 2.1 time: 0.151724 Jun 16 00:35:52.239469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 84/178] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:52 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:52.726646 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:52.729121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:52.733712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.734163 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.734915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:52.735349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:52.878600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:52.886388 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9ee592c3-84fb-4069-b8c1-c3bc9dcb7b8c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.163447 Jun 16 00:35:52.886913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 95/179] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:52 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:53.254708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:53.255467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:53.262083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.262612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.263487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.264144 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.398311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:53.408373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a7c93327-0cd2-48c8-b1af-79e2c9e95d10 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1550 microversion: 2.1 time: 0.158127 Jun 16 00:35:53.409523 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 85/180] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:53 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:53.903736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:53.904379 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:53.911569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.912019 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:53.912801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:53.913236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.055361 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.063484 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ad5b36bc-0020-4a14-861d-9a9cb2ff6a2a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.163631 Jun 16 00:35:54.064316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 96/181] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:53 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:54.435393 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:54.441520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:54.460645 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.460888 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.461496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.461927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.514877 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-1e1ba2d4-6d9d-4b9a-99e8-4e36d4566c49 req-1fbf17b7-46d2-4902-b69d-592deeeebf65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82ca4ac6-b12b-459b-a5b3-74f98b2aa635", "name": "network-vif-deleted", "tag": "432dd3b9-53d3-41b9-b199-4ccdb65e8510"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:35:54.525206 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-1e1ba2d4-6d9d-4b9a-99e8-4e36d4566c49 req-1fbf17b7-46d2-4902-b69d-592deeeebf65 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:54.525644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-1e1ba2d4-6d9d-4b9a-99e8-4e36d4566c49 req-1fbf17b7-46d2-4902-b69d-592deeeebf65 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:54.537294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-1e1ba2d4-6d9d-4b9a-99e8-4e36d4566c49 req-1fbf17b7-46d2-4902-b69d-592deeeebf65 service nova] Creating event network-vif-deleted:432dd3b9-53d3-41b9-b199-4ccdb65e8510 for instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 on hv-cinder-80382 Jun 16 00:35:54.539917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:54.542239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-1e1ba2d4-6d9d-4b9a-99e8-4e36d4566c49 req-1fbf17b7-46d2-4902-b69d-592deeeebf65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Jun 16 00:35:54.543359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 97/182] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:35:54.570535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-740fbc08-77fe-4663-afd2-cc3adc07c89c tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1508 microversion: 2.1 time: 0.141593 Jun 16 00:35:54.574091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 86/183] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:54 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:55.084881 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:55.085579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:55.091682 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.092173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.092923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.093362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.276963 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:55.285294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4c1a7362-ad4b-4bcf-bc33-d67f6655ad7e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.205065 Jun 16 00:35:55.285862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 98/184] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:55 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:55.587283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:55.587891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:55.594210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.594913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.595916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:55.596976 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:55.662445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:55.671004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-999d3462-047c-47fd-8fa4-c434a07f8a20 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1508 microversion: 2.1 time: 0.087670 Jun 16 00:35:55.671570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 87/185] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:55 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:56.302975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:56.303727 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:56.310734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.311391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.312316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.312773 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.645213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.653001 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f769a731-4d2a-468a-bec1-2433ec22343e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.355024 Jun 16 00:35:56.653563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 99/186] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:56 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:56.688134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:56.688767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:56.695846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.696297 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.697087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:56.697520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:56.764967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:56.776229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bcfc9cbd-4759-426e-9ea9-156212f65faa tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1508 microversion: 2.1 time: 0.090226 Jun 16 00:35:56.779369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 88/187] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:56 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1508 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:35:57.669669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:57.670274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:57.677378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.677830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.678620 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.679057 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.699284 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:57.795193 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:57.795898 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:57.802717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.803159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.804111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:57.804559 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:57.855185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.863726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d85a448f-a948-4324-b488-cda4be5ecadd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.197815 Jun 16 00:35:57.869416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 100/188] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:57 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:57.876406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:57.884540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-88241df1-c3ca-45a7-b3b2-558336882edc tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1343 microversion: 2.1 time: 0.093498 Jun 16 00:35:57.885300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 89/189] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:57 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1343 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:58.883528 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:58.884169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:58.890959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.891415 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.892341 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.892804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.902617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:35:58.903464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:35:58.909430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.916265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.916265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:35:58.916265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:35:58.977997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:58.984561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:58.987765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4fefbccc-de91-42f0-b596-4683714c1a64 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1343 microversion: 2.1 time: 0.090373 Jun 16 00:35:58.997076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 90/190] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:58 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1343 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:35:59.030345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:35:59.037775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5e012466-a322-404e-bff5-5976b910b708 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.158063 Jun 16 00:35:59.038340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 101/191] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:58 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:00.003901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:00.004513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:00.010903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.011354 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.012111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.012565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.054006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:00.054610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:00.061242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.061690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.062447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:00.062883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:00.075709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.084198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a41c6a9a-6c9f-488c-a111-42eb2ef1c987 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1343 microversion: 2.1 time: 0.084136 Jun 16 00:36:00.084796 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 91/192] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:35:59 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1343 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:00.194434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:00.201945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0ecaa761-ac2a-4407-b1fa-8f8057ea244d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.151820 Jun 16 00:36:00.202501 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 102/193] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:00 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:01.101301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:01.101930 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:01.108436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.108930 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.109768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.110209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.172863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.181541 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-00a1bf66-7c4f-48f5-8cc5-34cba8a2bad9 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1343 microversion: 2.1 time: 0.084103 Jun 16 00:36:01.182102 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 92/194] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:01 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1343 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:01.219378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:01.220003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:01.227090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.230404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.230404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:01.230404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:01.358060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:01.365610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0ac87b24-ae42-48e9-a92c-269fefa8d598 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.150002 Jun 16 00:36:01.366128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 103/195] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:01 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:02.060796 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-897851286", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:02.110835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] validate_networks() for None {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:02.198966 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.199634 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.205605 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.206079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.206851 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.207293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.246757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.247401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.247661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lazy-loading 'fault' on Instance uuid 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:02.300277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704b1cb48c7249d69ab69172d1a157b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9a178dbd5e430f874fa216367424dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:02.309034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-99f2b8dd-ddd3-496a-9fc0-bc1b07baf1e7 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 200 len: 1348 microversion: 2.1 time: 0.113868 Jun 16 00:36:02.309849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 104/196] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:02.382406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.383033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.389060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.389505 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.390254 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.390682 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.397694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:02.398247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:02.398716 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:02.399141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:02.399738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:02.410365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.410807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.414456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:02.415086 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:02.434405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Getting quotas for project a8d7918c87fc4feab324728c4739d326. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:02.438699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Getting quotas for user 881f9aedfd644810ab368bae004716c6 and project a8d7918c87fc4feab324728c4739d326. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:02.450489 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:02.452888 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:02.543466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:02.551456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f94f0d0f-ff65-4770-9384-840a4267af04 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.172903 Jun 16 00:36:02.552018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 105/197] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:02.628851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-02bae926-517a-41d2-b5d0-187e2fef9050 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571761 Jun 16 00:36:02.629897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 93/198] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:36:02.640260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d7fb64ca-02b9-4528-953a-bb8aa2c466aa tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:02.646521 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d7fb64ca-02b9-4528-953a-bb8aa2c466aa tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:02.703182 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7fb64ca-02b9-4528-953a-bb8aa2c466aa tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:02.711360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d7fb64ca-02b9-4528-953a-bb8aa2c466aa tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1214 microversion: 2.1 time: 0.074872 Jun 16 00:36:02.712401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 106/199] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:02 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:03.333091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.333702 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.339766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.340313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.341104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.341537 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.354443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] HTTP exception thrown: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Request method failure captured: Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 HTTP/1.1 Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqmuWYTRSl5ljw9sSY5Q_JGCu3xOLRMQoVbDx5DrDJk7d7LRC056FVKE7LZy_n9-xz8Pmksw0ibgSnQmRkFOE7wlsgDD7Pm21qKkNpcUeARt68pvT8R2FaPhj_c42SE3kc5m223Kkdf9NsTDzT00nsC99kIPXF6TeOTsWBAlMzHQmQ Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:36:03.358965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}] Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 704b1cb48c7249d69ab69172d1a157b1 Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.360513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '82ca4ac6-b12b-459b-a5b3-74f98b2aa635'} Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:03.366320 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.368156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.369418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Returning 404 to user: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:03.369418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fbb8824c-69dc-4920-981d-0baf7f1bc57b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 404 len: 111 microversion: 2.1 time: 0.031861 Jun 16 00:36:03.369418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 94/200] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:03.469648 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.470563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.480074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.480569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.481303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.481735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.493566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] HTTP exception thrown: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Request method failure captured: Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635/os-volume_attachments HTTP/1.1 Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqmuWYTRSl5ljw9sSY5Q_JGCu3xOLRMQoVbDx5DrDJk7d7LRC056FVKE7LZy_n9-xz8Pmksw0ibgSnQmRkFOE7wlsgDD7Pm21qKkNpcUeARt68pvT8R2FaPhj_c42SE3kc5m223Kkdf9NsTDzT00nsC99kIPXF6TeOTsWBAlMzHQmQ Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:36:03.497607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}] Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 704b1cb48c7249d69ab69172d1a157b1 Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.499013 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'server_id': '82ca4ac6-b12b-459b-a5b3-74f98b2aa635'} Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:03.499752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:03.500923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:03.502014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Returning 404 to user: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:03.502014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-46f7442a-f642-45df-a9cd-4d9a817e0b4b tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033337 Jun 16 00:36:03.502014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 107/201] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:03.569779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.570398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.577815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.578468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.583065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.583065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.715729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:03.723870 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f990c240-88ab-443b-a968-b25938140e6d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.158139 Jun 16 00:36:03.727756 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 95/202] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:03.729648 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:03.730255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:03.887229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.887683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.888504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:03.888975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:03.948853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:03.956858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-edafa6ae-5f0a-44fb-bc95-bc72066df42b tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1218 microversion: 2.1 time: 0.230956 Jun 16 00:36:03.957399 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 108/203] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:03 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:04.740819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:04.741534 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:04.749260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.749260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.749260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.749519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.831623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:04.832108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:04.839017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.839498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.840263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.840722 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.855286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] HTTP exception thrown: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Request method failure captured: Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 HTTP/1.1 Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqmuWYTRSl5ljw9sSY5Q_JGCu3xOLRMQoVbDx5DrDJk7d7LRC056FVKE7LZy_n9-xz8Pmksw0ibgSnQmRkFOE7wlsgDD7Pm21qKkNpcUeARt68pvT8R2FaPhj_c42SE3kc5m223Kkdf9NsTDzT00nsC99kIPXF6TeOTsWBAlMzHQmQ Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:36:04.857690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}] Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 704b1cb48c7249d69ab69172d1a157b1 Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.859048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '82ca4ac6-b12b-459b-a5b3-74f98b2aa635'} Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:04.859876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.861281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.862556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Returning 404 to user: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:04.862556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-14d54147-e060-4c37-b000-23785233c3e4 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 404 len: 111 microversion: 2.1 time: 0.031961 Jun 16 00:36:04.862556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 109/204] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:04 2022] DELETE /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:04.868329 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:04.869040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] [instance: 82ca4ac6-b12b-459b-a5b3-74f98b2aa635] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:04.876591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.876591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.881528 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.881528 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.891085 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:04.893251 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] HTTP exception thrown: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Request method failure captured: Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 HTTP/1.1 Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqmuWYTRSl5ljw9sSY5Q_JGCu3xOLRMQoVbDx5DrDJk7d7LRC056FVKE7LZy_n9-xz8Pmksw0ibgSnQmRkFOE7wlsgDD7Pm21qKkNpcUeARt68pvT8R2FaPhj_c42SE3kc5m223Kkdf9NsTDzT00nsC99kIPXF6TeOTsWBAlMzHQmQ Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:36:04.895622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2d9a178dbd5e430f874fa216367424dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2d9a178dbd5e430f874fa216367424dc"}]}] Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 2d9a178dbd5e430f874fa216367424dc Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-DeleteServersTestJSON-1661624836 Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 704b1cb48c7249d69ab69172d1a157b1 Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-DeleteServersTestJSON-1661624836-project Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.897271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '82ca4ac6-b12b-459b-a5b3-74f98b2aa635'} Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:04.898064 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. Jun 16 00:36:04.899316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:36:04.900452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] Returning 404 to user: Instance 82ca4ac6-b12b-459b-a5b3-74f98b2aa635 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:04.900452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1ebecb41-5b53-4805-9707-95f73faa7068 tempest-DeleteServersTestJSON-1661624836 tempest-DeleteServersTestJSON-1661624836-project] 10.222.0.20 "GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635" status: 404 len: 111 microversion: 2.1 time: 0.034833 Jun 16 00:36:04.901087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 110/205] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:04 2022] GET /compute/v2.1/servers/82ca4ac6-b12b-459b-a5b3-74f98b2aa635 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:04.903192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-94a325f1-25cb-4bed-97dc-f2a3060eb8e6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.166425 Jun 16 00:36:04.904046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 96/206] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:04 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:04.974200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:04.981890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:04.995333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:04.997797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:04.998748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.002696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.094614 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:05.106335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-75f58939-986c-4129-a39d-8e417cfc1b1f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1266 microversion: 2.1 time: 0.136400 Jun 16 00:36:05.116649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 111/207] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:04 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:05.920407 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:05.921285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:05.928001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.928483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:05.929314 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:05.929760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.123156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:06.123762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:06.130504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.130950 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.131706 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:06.132490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:06.199563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:06.207754 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7c5d5e7f-e108-4366-ac64-b649d9d4eaa9 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1272 microversion: 2.1 time: 0.088362 Jun 16 00:36:06.210119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 112/208] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:06 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:06.231173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:06.239270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-210561d7-c8ee-420a-bf5b-d4afc6f91bd8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.322908 Jun 16 00:36:06.244606 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 97/209] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:05 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:07.225563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:07.226313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:07.233454 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:07.234858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:07.236655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:07.238295 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:07.260480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:07.261142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:07.268708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:07.272200 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:07.275218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:07.284509 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:07.510541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.519147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4bab24f8-f41e-40d4-bb5c-13a6312e546f tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.297410 Jun 16 00:36:07.521727 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 113/210] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:07 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:07.613984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:07.623803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-27e7469e-3666-488e-876c-b05ee038d7fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.368047 Jun 16 00:36:07.626135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 98/211] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:07 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:08.542060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:08.542060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:08.546929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.547527 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.548332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.548790 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.642002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:08.642573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:08.649176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.649626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.650394 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.650817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.872675 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:08.882531 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4f0cc4f4-3fc6-44ee-976d-74de9c1940c5 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.347874 Jun 16 00:36:08.883569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 114/212] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:08 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:08.888571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-7dcbb472-f004-4277-bfd4-cc2dfba71a9d req-115ec837-a43f-4285-87da-1333b2d56ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c3ad64-d6e8-48a2-9835-f88e8d0ef11f", "tag": "94ce8402-0055-4b59-b7b9-1d09a0cbd6df"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:08.897585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7dcbb472-f004-4277-bfd4-cc2dfba71a9d req-115ec837-a43f-4285-87da-1333b2d56ed7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:08.918978 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7dcbb472-f004-4277-bfd4-cc2dfba71a9d req-115ec837-a43f-4285-87da-1333b2d56ed7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:08.946335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-7dcbb472-f004-4277-bfd4-cc2dfba71a9d req-115ec837-a43f-4285-87da-1333b2d56ed7 service nova] Creating event network-changed:94ce8402-0055-4b59-b7b9-1d09a0cbd6df for instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f on hv-cinder-80382 Jun 16 00:36:08.957381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-7dcbb472-f004-4277-bfd4-cc2dfba71a9d req-115ec837-a43f-4285-87da-1333b2d56ed7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072385 Jun 16 00:36:08.965419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 115/213] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:08.983918 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:09.001511 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e61e4630-5fa7-4d17-8be8-f33c4fb963f0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.363045 Jun 16 00:36:09.010841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 99/214] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:08 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:09.901058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:09.901763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:09.913077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.913077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:09.913077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:09.913077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.029313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:10.031246 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:10.045442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.050989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.050989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:10.050989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:10.115622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:10.123049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8f910014-f363-41a8-9228-10ea33b4f2eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.226163 Jun 16 00:36:10.125458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 116/215] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:09 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:10.351368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:10.358890 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-66ca939f-2b19-4f3d-83ee-9a7199916505 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.343907 Jun 16 00:36:10.359471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 100/216] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:10 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:11.141892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:11.143055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:11.151814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.152324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.157448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.160008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.318673 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:11.329157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9e4da061-735d-43e4-834b-fcd2908d67c8 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.191191 Jun 16 00:36:11.332454 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 117/217] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:11 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:11.377427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:11.379430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:11.389141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.389590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.390417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:11.390848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:11.541016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:11.548740 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-02d0c565-6221-4f5d-86f8-24c7682ccf00 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.176603 Jun 16 00:36:11.549603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 101/218] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:11 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:12.346935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:12.347548 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:12.351016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:12.354695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.355395 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.356406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.356973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.563049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:12.566197 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:12.569059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:12.572082 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8555d57f-ab68-4277-851b-6350eddfd595 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.228866 Jun 16 00:36:12.575778 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:12.576836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=6 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:12.578989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.579663 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.581264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:12.582090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:12.582400 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 118/219] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:12 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:12.822422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:12.829994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e711b869-5f94-4a36-b7fc-5857a4bfe9ad tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.268778 Jun 16 00:36:12.830584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 102/220] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:12 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:13.601264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:13.602464 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:13.608100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:13.610854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.611392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.612499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.613154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.760487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:13.768755 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-999aff10-3c43-4932-8f58-c0155c1c2510 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.182867 Jun 16 00:36:13.769354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 119/221] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:13 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:13.848350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:13.849119 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:13.852389 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:13.859030 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.859735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:13.860547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:13.861181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.007564 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:14.017935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d78f6392-d5d7-4850-acfe-2459b2dd8bb6 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1522 microversion: 2.1 time: 0.173995 Jun 16 00:36:14.027331 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 103/222] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:13 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:14.785620 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:14.786229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:14.793431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.793881 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.794641 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:14.795073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:14.815218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:14.946199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:14.954643 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-507a929f-67b0-40c5-93d4-6a92ca03a99a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.173139 Jun 16 00:36:14.955783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 120/223] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:14 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:15.035209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:15.036356 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:15.042641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.043093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.043860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.044299 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.432067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:15.439852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b829dc34-e7d2-485c-bd75-3f9f435bea50 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1502 microversion: 2.1 time: 0.408589 Jun 16 00:36:15.440410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 104/224] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:15 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:15.457961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:15.459065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:15.466714 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.467484 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.469902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.477070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.526193 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-2140c1dd-640c-470b-ac88-5f38987eb9e1 req-797fb8b5-11b3-44f9-86e5-507a66e45df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c3ad64-d6e8-48a2-9835-f88e8d0ef11f", "name": "network-vif-plugged", "status": "completed", "tag": "94ce8402-0055-4b59-b7b9-1d09a0cbd6df"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:15.537028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-2140c1dd-640c-470b-ac88-5f38987eb9e1 req-797fb8b5-11b3-44f9-86e5-507a66e45df5 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.537485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-2140c1dd-640c-470b-ac88-5f38987eb9e1 req-797fb8b5-11b3-44f9-86e5-507a66e45df5 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.548825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-2140c1dd-640c-470b-ac88-5f38987eb9e1 req-797fb8b5-11b3-44f9-86e5-507a66e45df5 service nova] Creating event network-vif-plugged:94ce8402-0055-4b59-b7b9-1d09a0cbd6df for instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f on hv-cinder-80382 Jun 16 00:36:15.554753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-2140c1dd-640c-470b-ac88-5f38987eb9e1 req-797fb8b5-11b3-44f9-86e5-507a66e45df5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Jun 16 00:36:15.555349 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 105/225] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:15.649258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:15.657480 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-834a2d89-8f9e-430e-b970-ecce2623f4b9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1514 microversion: 2.1 time: 0.203917 Jun 16 00:36:15.658492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 121/226] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:15 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:15.972628 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:15.973850 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:15.980370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.982075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:15.982075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:15.982075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:16.144668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:16.154217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-21ddac23-f6d4-4911-b70e-becb0c485d4c tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.186284 Jun 16 00:36:16.155712 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 106/227] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:15 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:17.173554 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:17.174333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:17.182736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.183357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.184406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.185434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.322786 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:17.331241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b5bb9a1c-d15e-4867-bdb2-ceae3eb051dd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1314 microversion: 2.1 time: 0.162466 Jun 16 00:36:17.331812 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 122/228] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:17 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:17.519005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:17.519951 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:17.526599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.533001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.533001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.533001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.549818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'flavor' on Instance uuid b99af546-f8bc-4967-b251-7e486805f7f7 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:17.669182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:17.913818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4f789482-f749-4c29-a0d0-6b5ce13c4027 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/action" status: 200 len: 32 microversion: 2.1 time: 0.398766 Jun 16 00:36:17.914419 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 107/229] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:36:17 2022] POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:36:17.923470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:17.924077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:17.930376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.930537 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:17.931284 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:17.931716 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.070029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:18.095044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ebac7958-c079-42b6-b3a8-1bba5b9b1556 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.175402 Jun 16 00:36:18.097310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 123/230] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:17 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:18.349007 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:18.349605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:18.358911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.358911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.358911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.358911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.639973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:18.653109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9101dd0d-3d57-486c-b467-9f4d2224f47d tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1464 microversion: 2.1 time: 0.308567 Jun 16 00:36:18.655436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 108/231] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:18 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:18.702009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:18.702518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:18.709172 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.709628 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.710426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:18.710883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:18.735959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:36:19.086422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f3844e49-e91a-495d-a5d6-4322d8612e43 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "DELETE /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 204 len: 0 microversion: 2.1 time: 0.387986 Jun 16 00:36:19.087108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 124/232] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:36:18 2022] DELETE /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:36:19.100145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:19.100722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:19.107132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.107581 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.116675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.116675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.116889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:19.116889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:19.120462 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.120937 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.121695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:19.122123 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:19.261877 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:19.277396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1c8f8aa3-008d-4bc4-9686-b30e6f9a62be tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1470 microversion: 2.1 time: 0.179623 Jun 16 00:36:19.278265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 109/233] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:19 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:19.326240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:19.335443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f6a8b145-b631-4f8d-85b6-9b0195739637 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.226547 Jun 16 00:36:19.344745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 125/234] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:19 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:20.295167 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:20.295778 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:20.306139 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.306667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.307396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.307828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.365616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:20.365616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:20.367058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.367305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.371539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:20.373017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:20.473101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:20.482573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1387efc7-bb5c-4275-acef-62d9bc4b2d0a tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1470 microversion: 2.1 time: 0.190799 Jun 16 00:36:20.483277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 110/235] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:20 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:20.581374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:20.589897 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8a8918da-cee1-4eab-907b-4c1e22370052 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.239132 Jun 16 00:36:20.590458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 126/236] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:20 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:21.499355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:21.499957 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:21.510568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.510568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.510568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.510568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.607721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:21.608329 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:21.616570 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.617007 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.617831 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:21.618277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:21.639420 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:21.647327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a9308be7-56eb-4416-8868-ee8b02f1c873 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1470 microversion: 2.1 time: 0.152123 Jun 16 00:36:21.647892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 111/237] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:21 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:21.748368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:21.756619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f9150dcd-8f4d-477f-a1f0-282585aeef94 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.153270 Jun 16 00:36:21.757193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 127/238] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:21 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:22.664497 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:22.665124 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:22.677928 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.678406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.679174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.679587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.774605 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:22.775264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:22.781834 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.782276 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.783032 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:22.783513 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:22.812288 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:22.821216 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0f701d94-8ef7-408e-9039-1661e06c82bd tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1470 microversion: 2.1 time: 0.160299 Jun 16 00:36:22.821788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 112/239] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:22 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:22.924488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:22.932650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8e7580a6-00de-4cc6-98d4-f231b8ee64ba tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.161588 Jun 16 00:36:22.933210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 128/240] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:22 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:23.839078 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:23.839951 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:23.846166 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.846762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:23.847461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.847897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:23.960664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:23.961795 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:23.969655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.970176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:23.971009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:23.971555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.058217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:24.068408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b2d7983a-9f85-4ed1-ba93-3445288129eb tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1470 microversion: 2.1 time: 0.233280 Jun 16 00:36:24.069023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 113/241] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:23 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:24.112925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:24.120476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3fe83e94-38ac-48e0-8412-9b05e0fa7465 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.173374 Jun 16 00:36:24.121229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 129/242] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:23 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:24.260344 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-a2ba8b6c-e00c-4abc-b211-d4a03dfdceb7 req-b6cc58fd-8555-43e4-8d41-58d50e7dcfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c3ad64-d6e8-48a2-9835-f88e8d0ef11f", "name": "network-vif-deleted", "tag": "94ce8402-0055-4b59-b7b9-1d09a0cbd6df"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:24.269211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-a2ba8b6c-e00c-4abc-b211-d4a03dfdceb7 req-b6cc58fd-8555-43e4-8d41-58d50e7dcfcd service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:24.269659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-a2ba8b6c-e00c-4abc-b211-d4a03dfdceb7 req-b6cc58fd-8555-43e4-8d41-58d50e7dcfcd service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.282928 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-a2ba8b6c-e00c-4abc-b211-d4a03dfdceb7 req-b6cc58fd-8555-43e4-8d41-58d50e7dcfcd service nova] Creating event network-vif-deleted:94ce8402-0055-4b59-b7b9-1d09a0cbd6df for instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f on hv-cinder-80382 Jun 16 00:36:24.288383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-a2ba8b6c-e00c-4abc-b211-d4a03dfdceb7 req-b6cc58fd-8555-43e4-8d41-58d50e7dcfcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035830 Jun 16 00:36:24.289023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 114/243] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:24.761258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:24.761739 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:24.767830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:24.768221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.769027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:24.769465 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:24.797966 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-71ff4579-fbd8-4e26-86b5-574fc03f43c7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.040741 Jun 16 00:36:24.798547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 130/244] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:36:24 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:25.086431 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:25.087115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:25.093851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.094296 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.095050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.095479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.126899 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.127389 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.127949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lazy-loading 'fault' on Instance uuid 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:25.138640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:25.139285 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:25.145332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.146265 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.147035 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:25.147477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:25.174732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881f9aedfd644810ab368bae004716c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8d7918c87fc4feab324728c4739d326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:25.182562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-568d6121-d79c-4b0a-80a2-06e8f5ede9b2 tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 200 len: 1304 microversion: 2.1 time: 0.100718 Jun 16 00:36:25.184670 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 115/245] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:25 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:25.288845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:25.297250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-95034ad3-741d-43f8-bfee-4184bf690e93 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.162863 Jun 16 00:36:25.298715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 131/246] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:25 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:26.204323 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:26.204987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] [instance: 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:26.218927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.219379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.220665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.221577 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.245790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] HTTP exception thrown: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Request method failure captured: Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f HTTP/1.1 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnru4pfXT1fDkhMoCbq_aV2Z5mw4F0CCTsTokueEmOXrKfzGnoMI6rDlRapCcBu6s4ntPt9-6ywWhWk46KKWOe8-08x7qBzc25iaUczShMYTyT_ebc4I68oOzcPBRDy7T6CScbusMH-us2aFr2Icvi1CIVs-FZ-lAuPGfBZMEzqSxBo Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a8d7918c87fc4feab324728c4739d326 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-VolumesNegativeTest-1287618869 Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:36:26.248575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8d7918c87fc4feab324728c4739d326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a8d7918c87fc4feab324728c4739d326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a8d7918c87fc4feab324728c4739d326"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a8d7918c87fc4feab324728c4739d326"}]}] Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-VolumesNegativeTest-1287618869 Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a8d7918c87fc4feab324728c4739d326 Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-VolumesNegativeTest-1287618869 Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-VolumesNegativeTest-1287618869-project Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 881f9aedfd644810ab368bae004716c6 Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-VolumesNegativeTest-1287618869-project Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. Jun 16 00:36:26.250623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '43c3ad64-d6e8-48a2-9835-f88e8d0ef11f'} Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:26.252383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. Jun 16 00:36:26.254017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:26.256767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] Returning 404 to user: Instance 43c3ad64-d6e8-48a2-9835-f88e8d0ef11f could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:26.256767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-68f9a8e8-3ef6-4a8f-8308-c066688aefec tempest-VolumesNegativeTest-1287618869 tempest-VolumesNegativeTest-1287618869-project] 10.222.0.20 "GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f" status: 404 len: 111 microversion: 2.1 time: 0.048384 Jun 16 00:36:26.256767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 116/247] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:26 2022] GET /compute/v2.1/servers/43c3ad64-d6e8-48a2-9835-f88e8d0ef11f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:26.315623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:26.316244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:26.325929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.325929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.325929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:26.325929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:26.476764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:26.484623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-04a51ea2-1d00-4ee5-babb-60b126e877a9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.173352 Jun 16 00:36:26.485261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 132/248] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:26 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:27.502054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:27.502832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:27.509382 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.509832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.510593 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:27.511031 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:27.657465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:27.665100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6c39b0e4-4d51-4448-b69d-88d0bb318d24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.166739 Jun 16 00:36:27.665801 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 117/249] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:27 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:28.686481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:28.687092 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:28.693906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.695503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:28.697904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:28.699443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:28.834725 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:28.843521 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-00a62e15-6ccb-4280-8755-519b6b743409 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.160259 Jun 16 00:36:28.843521 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 133/250] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:28 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:29.860365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:29.861246 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:29.867808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:29.868372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:29.869300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:29.869839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:30.013126 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:30.022036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6460a5e0-edaa-4828-a154-75fe471a0c1d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.165226 Jun 16 00:36:30.022713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 118/251] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:29 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:30.031926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3c1843e-57f9-4da7-8436-cd62402cd480"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:30.033615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:30.041148 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:30.042136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:30.043105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:30.043704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:30.883771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:31.038845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:31.039445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:31.046123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:31.046322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:31.047085 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:31.047527 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:31.053939 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-446a31f9-474b-4d93-b0be-fec4f88d94fa tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035286 Jun 16 00:36:31.055494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 134/252] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:30 2022] POST /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:31.234822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:31.243903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1b664b7c-c039-4ff0-93a7-9b24392f5af3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.208878 Jun 16 00:36:31.244572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 119/253] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:31 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:32.263755 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:32.264619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:32.272053 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.272435 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.273404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:32.273860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:32.452850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:32.460787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b823cc5d-a09a-4b1b-81a4-5fa22f7efaf1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.202189 Jun 16 00:36:32.461370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 135/254] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:32 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:33.478701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:33.479314 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:33.486012 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:33.486461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:33.487325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:33.487781 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:33.646438 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:33.663446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f7dc8b79-c1bc-4f1d-b59f-407cbd3b100d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.188638 Jun 16 00:36:33.664034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 120/255] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:33 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:34.682685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:34.683291 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:34.691205 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:34.692322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:34.693129 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:34.693729 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:34.838144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:34.858331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1a19f30d-edd8-46f4-9356-dfbc277b96b0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.170768 Jun 16 00:36:34.858331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 136/256] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:34 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:35.753828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:35.755111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:35.769476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:35.773486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:35.774521 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:35.775293 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:35.866478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:35.867103 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:35.874253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:35.875637 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:35.876725 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:35.877346 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:35.964763 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6b44c9fb-c5fe-4e59-a2bd-d21d988cd8f2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/ips" status: 200 len: 152 microversion: 2.20 time: 0.215051 Jun 16 00:36:35.972771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 121/257] 10.222.0.20 () {60 vars in 1288 bytes} [Thu Jun 16 00:36:35 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/ips => generated 152 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:36:36.027342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:36.034767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9c88ecea-4dab-43a8-b570-90cfe8d2867f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.172922 Jun 16 00:36:36.035401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 137/258] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:35 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:37.052415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:37.053102 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:37.058995 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:37.059436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:37.060213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:37.060666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:37.185923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:37.194087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6519d2bb-40f9-4c63-8f3c-ccd73cb3087a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.145669 Jun 16 00:36:37.194631 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 122/259] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:37 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:38.211598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:38.212119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:38.218618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.219065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.219955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:38.220397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:38.353426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:38.361825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-48d45073-a8fb-4d19-9dce-707374ccb3b4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.154765 Jun 16 00:36:38.362535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 138/260] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:38 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:39.379023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:39.380205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:39.386514 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.386964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.387711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.388144 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.403991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:39.405289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:39.417099 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.417662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.418511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:39.419024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:39.461707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lazy-loading 'flavor' on Instance uuid 787e855e-1684-4ea2-aeeb-6e5737f35194 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:36:39.567090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:39.574503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-81f3911d-5423-4bb8-a471-b015f058980f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.199141 Jun 16 00:36:39.575963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 123/261] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:39 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:40.106289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f8647381-e3c7-487b-ac37-4f94c59ee3e4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/action" status: 202 len: 0 microversion: 2.20 time: 0.706267 Jun 16 00:36:40.106923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 139/262] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jun 16 00:36:39 2022] POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:36:40.116407 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:40.116943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:40.123463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.124123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.124935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.125369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.237807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5faa4287-1cb1-4922-9f01-5d0d965dc1af tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: .version_select at 0x7f2a7bd71700>, body: {"keypair": {"name": "tempest-keypair-289509339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5QqjjuDviIxPUTRbIJjeXDJKOqMSeapFQtmb0fjiRYteTGm8o1FLRuyjJTWVIkmMkvmriOm26HUG20VndAbMSrTrXp5Pp0PP1e+OIM1yrCvP8qctmSFCC1SisJWJcSxA=="}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:40.259627 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-5faa4287-1cb1-4922-9f01-5d0d965dc1af tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:40.263772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-5faa4287-1cb1-4922-9f01-5d0d965dc1af tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:40.273963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:40.282501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:40.284623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:40.285975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1bfbd4ad-cd19-47d1-9934-1922d7e3c4b4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.174554 Jun 16 00:36:40.286519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 124/263] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:40 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:40.396442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5faa4287-1cb1-4922-9f01-5d0d965dc1af tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162670 Jun 16 00:36:40.397492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 140/264] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:36:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:40.592930 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:40.593682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:40.599819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.600276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.601070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:40.601505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:40.619063 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:40.787369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:40.794820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f95f69e9-7122-4e58-a816-8eafd7469805 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.205812 Jun 16 00:36:40.795377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 125/265] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:40 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:41.304846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:41.305572 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:41.312194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.312771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.313519 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.313945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.457114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:41.466078 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:41.467967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:41.469168 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-02858be0-c5d1-4bcb-a8f4-4ac38eea6330 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.168458 Jun 16 00:36:41.469717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 141/266] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:41 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:41.812458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:41.813646 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:41.820894 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.823501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:41.824293 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:41.824767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:42.023232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:42.031058 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-62aea5c7-0df5-4285-b215-c109f759bfaa tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.222285 Jun 16 00:36:42.031625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 126/267] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:41 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:42.487291 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:42.487896 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:42.496678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:42.497127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:42.497896 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:42.498321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:42.650669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:42.659024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:42.660556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:42.661724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-82df3aa7-bffc-4cba-b17d-e12a5d074d4b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.178317 Jun 16 00:36:42.662562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 142/268] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:42 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:43.057472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:43.058988 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:43.070571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.071285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.072380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.073036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.237252 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1108337119", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffe9c59a-3096-4aef-8b2e-e3aa63722c28"}], "security_groups": [{"name": "tempest-securitygroup--1354403442"}], "key_name": "tempest-keypair-289509339", "user_data": "}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:43.367112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] validate_networks() for [('ffe9c59a-3096-4aef-8b2e-e3aa63722c28', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:43.438779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:43.449291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2fd55879-8755-4faf-a185-0b8a0800039c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.398441 Jun 16 00:36:43.452609 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 127/269] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:43 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:43.682860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:43.683807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:43.691534 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.692145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.693607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.694291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.886825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:43.888775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:43.888775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:43.888775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:43.888775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:43.903391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.904212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.905514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:43.906164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:43.931296 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:43.941160 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:43.959287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:43.975268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:43.975268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:43.975268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-97058b59-70cc-4222-8ed5-4dab14ccbe6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.296117 Jun 16 00:36:43.980772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 128/270] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:43 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:43.983311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:43.985707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:44.158069 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-77496d5a-c979-4ccc-b602-dd5e0f88f700 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.925053 Jun 16 00:36:44.159375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 143/271] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:36:44.174280 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f0727b08-3848-4993-899b-cef8e40b1644 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:44.175696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f0727b08-3848-4993-899b-cef8e40b1644 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:44.239151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f0727b08-3848-4993-899b-cef8e40b1644 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:44.249961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f0727b08-3848-4993-899b-cef8e40b1644 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1241 microversion: 2.1 time: 0.080790 Jun 16 00:36:44.251059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 129/272] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:44 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:44.467450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:44.468050 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:44.475648 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.476100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.476907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.477541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.636631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:44.646431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bafd48ef-619e-40bd-9cc1-610c25832391 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1500 microversion: 2.1 time: 0.182873 Jun 16 00:36:44.647057 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 144/273] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:44 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1500 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:44.668415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c17cde4-9c34-41eb-aa93-88b845930da8"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:44.669915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:44.681394 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.681841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.683066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.683852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.709985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] HTTP exception thrown: Cannot 'attach_volume' instance b99af546-f8bc-4967-b251-7e486805f7f7 while it is in vm_state rescued Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Request method failure captured: Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/os-volume_attachments HTTP/1.1 Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 74 Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqut7v3ybWuAnrqMcwjd_4c8R3L_IH68MNR5jafHKKTh49sm50FoSRXqCiOJobjLW9BpA0h-S7ruzCdwqpL0kg0NFc04RbG98gNfkfCDCcFZL5PdzyZLcWBQRXTM5kWwv4_cCdovYl8vuA3s9obwbYWEaTzMAWMbiX5JyZOrCAOw8g Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:36:44.711817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}] Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: c9dcfb252f0d44a280b3448094883e13 Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {"volumeAttachment": {"volumeId": "8c17cde4-9c34-41eb-aa93-88b845930da8"}} Jun 16 00:36:44.713211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Cannot 'attach_volume' instance b99af546-f8bc-4967-b251-7e486805f7f7 while it is in vm_state rescued Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'server_id': 'b99af546-f8bc-4967-b251-7e486805f7f7', 'body': {'volumeAttachment': {'volumeId': '8c17cde4-9c34-41eb-aa93-88b845930da8'}}} Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b99af546-f8bc-4967-b251-7e486805f7f7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:36:44.713973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b99af546-f8bc-4967-b251-7e486805f7f7 while it is in vm_state rescued Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:36:44.715213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:36:44.716451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:36:44.716451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:36:44.716451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b99af546-f8bc-4967-b251-7e486805f7f7 while it is in vm_state rescued Jun 16 00:36:44.716451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:36:44.717541 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Returning 409 to user: Cannot 'attach_volume' instance b99af546-f8bc-4967-b251-7e486805f7f7 while it is in vm_state rescued {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:36:44.718601 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-583dd27d-011f-45cd-87c6-2bd5d78d4809 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057158 Jun 16 00:36:44.722954 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 130/274] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:36:44 2022] POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:36:44.728171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:44.728756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:44.740764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.741310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.742646 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.743108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:44.991730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:44.992942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:44.999128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:44.999617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.000415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.000854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.021204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bc2d619f-5c3c-4263-bc37-a7861adc87a4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/action" status: 202 len: 0 microversion: 2.1 time: 0.295050 Jun 16 00:36:45.025164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 145/275] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:36:44 2022] POST /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:36:45.040686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:45.041870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:45.045378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:45.050481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.050481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.051029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.051499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.205200 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.223575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.225292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.227115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f1b19ca4-2455-450d-9b69-93d4cbc1ebb7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.239189 Jun 16 00:36:45.227542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 131/276] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:44 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:36:45.267612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:45.268212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:45.275130 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.275282 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.276487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:45.276949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:45.297721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.308474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-835f35bb-e4ce-42e4-be23-7032440c71ff tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1508 microversion: 2.1 time: 0.272834 Jun 16 00:36:45.309067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 146/277] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:45 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:45.376597 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:45.383882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-04bc9078-b4b1-4f89-8eb3-ba8bb99f87ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1245 microversion: 2.1 time: 0.120187 Jun 16 00:36:45.393674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 132/278] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:45 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:46.100601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-587172904", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "networks": [{"uuid": "03feb970-ecf8-40b0-b2d6-45c5b0cb82d7"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:46.151971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] validate_networks() for [('03feb970-ecf8-40b0-b2d6-45c5b0cb82d7', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:46.245709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.246230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.248134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=64 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:46.252838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.253294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.254094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.254534 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.384221 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.392447 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.393996 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.395213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ae73d9be-417c-4e18-aa6e-eac99b43eef7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.153486 Jun 16 00:36:46.396050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 133/279] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:36:46.401207 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.401817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.407846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.408318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.409107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.409576 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.512506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:46.513040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:46.513520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:46.513952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:46.514370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:46.523558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.524008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.525541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.526297 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.544190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Getting quotas for project 213787a3040e45efb2c14f5dd9dcf509. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:46.548235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Getting quotas for user 6294a11cbb2a475da4864ca15b7959d5 and project 213787a3040e45efb2c14f5dd9dcf509. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:46.548913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.556749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d2c7fb79-6e8a-47b6-a9d6-f3caafa14420 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1508 microversion: 2.1 time: 0.159611 Jun 16 00:36:46.557378 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 134/280] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:46.559659 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:46.561954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:46.567036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.567728 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.576831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.578165 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.579008 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:46.579451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:46.642848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.650257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ee46654c-318b-4b1a-9af3-45ec4717725a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1293 microversion: 2.1 time: 0.087185 Jun 16 00:36:46.650818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 135/281] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:46.693567 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e62b3e9d-b7a9-4dbf-a1de-7ad01746920b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596768 Jun 16 00:36:46.694203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 147/282] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:36:46.704174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-67ce69b4-6aa9-427c-9fef-eff244c9b0e6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:46.704815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-67ce69b4-6aa9-427c-9fef-eff244c9b0e6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:46.767222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-67ce69b4-6aa9-427c-9fef-eff244c9b0e6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:46.777325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-67ce69b4-6aa9-427c-9fef-eff244c9b0e6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1218 microversion: 2.1 time: 0.076506 Jun 16 00:36:46.778218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 136/283] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:46 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:47.413895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:47.414567 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:47.422132 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.422585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.423358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.423832 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.558416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.566559 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.568057 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.569333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-11ca5c83-7657-43a5-9f12-b6340214d798 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.159401 Jun 16 00:36:47.575358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 148/284] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:47 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:47.575484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:47.575484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:47.581042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.581488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.582308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.582717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.668003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:47.668650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:47.675063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.675558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.676364 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:47.676842 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:47.725680 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.734247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-eb520516-4ce4-4204-9472-6a060ea3ac4c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1508 microversion: 2.1 time: 0.164510 Jun 16 00:36:47.734805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 137/285] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:47 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:47.740715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.749294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7ae349d3-7187-45a7-8858-97f19071557e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1293 microversion: 2.1 time: 0.085615 Jun 16 00:36:47.749860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 149/286] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:47 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:47.796046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fa91e544-2bec-4521-8ef0-3a317975bffa tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:47.796556 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fa91e544-2bec-4521-8ef0-3a317975bffa tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:47.849905 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fa91e544-2bec-4521-8ef0-3a317975bffa tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:47.856722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fa91e544-2bec-4521-8ef0-3a317975bffa tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1218 microversion: 2.1 time: 0.064951 Jun 16 00:36:47.857276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 138/287] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:47 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:48.588617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:48.703555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:48.703555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.703555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.703555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.703917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.703917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:48.736054 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.746362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.748048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.749392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e1f0d667-45f6-4b0f-bc5f-43ac3e4522df tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.165616 Jun 16 00:36:48.750158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 150/288] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:48 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:48.752718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:48.753330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:48.760054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.760616 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.761578 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.762020 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.767564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:48.767564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:48.773054 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.773507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.774862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.775305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.836598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.843958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bebcb104-ebd0-4482-b2a6-b89f31b3602c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1293 microversion: 2.1 time: 0.081825 Jun 16 00:36:48.845034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 151/289] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:48 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:48.874279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:48.874912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:48.881134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.881592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.882381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:48.882821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:48.903983 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.912137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-88d4bd20-ea02-46c1-9b9e-4beca1f54dcd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1508 microversion: 2.1 time: 0.163286 Jun 16 00:36:48.912733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 139/290] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:48 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:48.950701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:48.962277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-92a644c1-8308-42aa-983a-a3b6d1f091e3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1222 microversion: 2.1 time: 0.091630 Jun 16 00:36:48.963135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 152/291] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:48 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:49.775654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:49.776255 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:49.782261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.782712 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:49.783460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.783894 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:49.861685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:49.862436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:49.869819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.870618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:49.871397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.871839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:49.949738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:49.957983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3fb4cc3b-0c02-4558-8590-f887f7f46ad7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1293 microversion: 2.1 time: 0.100085 Jun 16 00:36:49.958940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 153/292] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:49 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:49.964065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:49.964779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:49.971540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.971998 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:49.972803 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:49.973241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:50.115140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:50.122870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0bea8705-ba5b-48b5-8437-1cfa365d01f4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1508 microversion: 2.1 time: 0.162804 Jun 16 00:36:50.123443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 154/293] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:49 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:50.127870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:50.128478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:50.137651 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.138103 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:50.138883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.139328 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:50.201481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:50.209976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:50.214768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:50.217281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:50.218445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a6194e68-bbe9-431e-8a0a-4909fbc80647 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.447204 Jun 16 00:36:50.219288 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 140/294] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:49 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:50.219985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e741aa64-bbff-4e21-8f77-b56583b2980f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1222 microversion: 2.1 time: 0.095511 Jun 16 00:36:50.229429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 155/295] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:50 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:50.975038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:50.975758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:50.982276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.982727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:50.983489 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:50.983924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.043789 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.051097 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-082a755c-4537-48e3-a2fa-bb0f27bc3f15 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1301 microversion: 2.1 time: 0.079930 Jun 16 00:36:51.051648 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 141/296] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:50 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:51.139149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:51.139752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:51.146616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.147062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.147820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.148459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.236756 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:51.237483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:51.244283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.245027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.245820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.246261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.310306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.321513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4f5be922-da29-4e49-a513-0cf7b165826d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1214 microversion: 2.1 time: 0.088489 Jun 16 00:36:51.322687 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 142/297] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:51 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:51.327596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:51.328446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:51.336735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.337991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.339030 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:51.339659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:51.490774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.501666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7d863e02-6174-4583-b2e0-80cfe6d5b8d5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1514 microversion: 2.1 time: 0.366254 Jun 16 00:36:51.502310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 156/298] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:51 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:51.572239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.585634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.587822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:51.593346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4956088f-cfec-4926-8a12-23b7af492d6f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.269461 Jun 16 00:36:51.594137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 143/299] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:51 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:52.070341 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.071595 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.083510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.092864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.095835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.095835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.204548 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.234204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e98d3021-50fd-49cd-9dc0-3d9c32fb8ef6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1299 microversion: 2.1 time: 0.169056 Jun 16 00:36:52.240715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 157/300] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:52 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:52.344278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.345597 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.352284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.353510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.354412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.355049 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.457542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.466572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b7a370bc-5a32-43e0-ac16-2eda58a5aa49 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1270 microversion: 2.1 time: 0.126662 Jun 16 00:36:52.467494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 144/301] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:52 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1270 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:52.614328 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:52.614932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:52.621024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.622318 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.622318 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:52.622639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:52.768867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.777650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.779154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:52.780376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-611a3b6d-1d36-413e-ab42-b241b9b82f5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.169852 Jun 16 00:36:52.780957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 158/302] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:52 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:53.257713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:53.258318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:53.264881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.265333 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.266084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.266517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.285052 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:53.395735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.403736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-698a22a7-5b19-4a0d-b650-607535976b2d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.149874 Jun 16 00:36:53.409304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 145/303] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:53 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:53.483258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:53.483865 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:53.490895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.491380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.492149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.492609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.556505 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.563963 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3add5b9a-2c8a-4ddf-a811-808562328884 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1288 microversion: 2.1 time: 0.084576 Jun 16 00:36:53.564665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 159/304] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:53 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:53.798679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:53.799277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:53.805259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.806274 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.807042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:53.807468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:53.934984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.942990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.944479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:53.945635 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0415a8bd-6b31-4556-a7f2-d953161fdabc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.150821 Jun 16 00:36:53.946202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 146/305] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:53 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:54.420715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:54.422304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:54.428580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.429037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.429806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.430248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.555609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:54.563135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-614493f8-40b7-43b5-8328-54d692478a0f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.147115 Jun 16 00:36:54.563687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 160/306] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:54 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:54.581252 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:54.581858 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:54.588332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.588817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.589577 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.590009 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.653010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:54.660385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f8b12272-fa03-4287-97e7-5dba5200d8d0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1288 microversion: 2.1 time: 0.082997 Jun 16 00:36:54.660985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 147/307] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:54 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:54.964422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:54.965104 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:54.971187 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.971635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:54.972393 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:54.972854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.107581 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:55.115347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:55.116852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:55.117983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-92dd5107-1a1e-4083-a627-a179f3c20892 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.158197 Jun 16 00:36:55.118530 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 161/308] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:54 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:55.579900 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:55.580748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:55.587596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:55.588222 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.588836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:55.589278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.676892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:55.681165 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:55.688906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:55.690463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.691404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:55.691985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:55.759441 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:55.767084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7874ee61-6488-4169-b065-03fe87475691 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1276 microversion: 2.1 time: 0.094086 Jun 16 00:36:55.771102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 162/309] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:55 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:55.943186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:55.951231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a8d8588d-4738-49ea-af15-c3c308900b87 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.375642 Jun 16 00:36:55.951819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 148/310] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:55 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:56.137612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:56.138218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:56.144241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.144734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.145507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.145954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.296939 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:56.308083 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:56.314545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:56.314545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7e3ff1aa-842f-4d7b-bf06-169d1ecc92a5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.179926 Jun 16 00:36:56.325082 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 163/311] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:56 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:56.397947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-706b910d-304f-4684-b807-d590f546838c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: .version_select at 0x7f2a7b5a5700>, body: {"keypair": {"name": "tempest-keypair-886926461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2OICeGs5ctKaTFjRvcteaw3NZT997mHKw4LaDHNOl2Yhtf4oOED2l5O7AuV6OCaahQIEeWH2PIdHoixrOpZSRZx152pN9FMHnwpd5KDM+o8et4A9/PAD3lDTY0X5fOgg=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:56.424281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-706b910d-304f-4684-b807-d590f546838c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:56.429797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-706b910d-304f-4684-b807-d590f546838c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for user c9dcfb252f0d44a280b3448094883e13 and project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:56.563069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-706b910d-304f-4684-b807-d590f546838c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169326 Jun 16 00:36:56.568645 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 149/312] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:36:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:56.790131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:56.791924 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:56.800067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=4 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:56.800929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=16 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:56.808266 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.810745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.811719 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.815823 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.829141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-de00ee0a-7ec4-4d25-ad1a-4c917ee2d133 req-c010822f-8489-4e1c-8119-cb8ea4cf582c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac529ee5-1040-4f28-acb9-4346e98dba6d", "tag": "1a6c10c9-930f-4464-af5a-19b5b85c5bc2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:56.851325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-de00ee0a-7ec4-4d25-ad1a-4c917ee2d133 req-c010822f-8489-4e1c-8119-cb8ea4cf582c service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.852128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-de00ee0a-7ec4-4d25-ad1a-4c917ee2d133 req-c010822f-8489-4e1c-8119-cb8ea4cf582c service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.889916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-de00ee0a-7ec4-4d25-ad1a-4c917ee2d133 req-c010822f-8489-4e1c-8119-cb8ea4cf582c service nova] Creating event network-changed:1a6c10c9-930f-4464-af5a-19b5b85c5bc2 for instance ac529ee5-1040-4f28-acb9-4346e98dba6d on hv-cinder-80382 Jun 16 00:36:56.901370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-de00ee0a-7ec4-4d25-ad1a-4c917ee2d133 req-c010822f-8489-4e1c-8119-cb8ea4cf582c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094104 Jun 16 00:36:56.902414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 150/313] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:56.970897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:56.977493 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:56.982334 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.983155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:56.984093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:56.985530 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.057946 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:57.066267 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-896915d2-604d-4014-bfb0-1734925e3ad7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.284478 Jun 16 00:36:57.067014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 164/314] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:56 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:57.294471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:57.302499 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-686e0cc5-c39b-4653-a3ff-17d0f971c564 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.337643 Jun 16 00:36:57.303073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 151/315] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:56 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:57.334902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:57.335585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:57.343081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.343538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.344310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:57.344845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:57.526422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:57.536786 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:57.538476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:57.539643 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9b14276d-1fd5-4bbf-83e0-6c12875a79b1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.211776 Jun 16 00:36:57.540189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 165/316] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:57 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:58.083448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:58.084101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:58.091096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.091544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.092294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.092750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.233048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:58.241705 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6b731079-c40e-49e2-97d7-d47723e55e8f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.162250 Jun 16 00:36:58.242462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 152/317] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:58 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:58.319546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:58.320086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:58.326624 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.327069 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.327832 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.328267 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.510066 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:58.517358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-33e1e816-37db-4a59-9bdb-73a3715dcf62 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.201674 Jun 16 00:36:58.518473 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 166/318] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:58 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:36:58.557990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:58.558588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:58.564538 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.565261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.566016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.566448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.695684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:58.704303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:58.705844 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:58.706984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7a914f97-d2ce-41b2-a132-f0e879ba4b8f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.153028 Jun 16 00:36:58.707531 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 153/319] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:58 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:36:58.921232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-51562339-008b-4f81-bef7-41506b7caf37 req-d3a26666-d01f-4854-a58c-7e47e875aebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90e80cd-430b-414f-bf31-7641c0490c88", "tag": "54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:58.929344 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-51562339-008b-4f81-bef7-41506b7caf37 req-d3a26666-d01f-4854-a58c-7e47e875aebf service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:58.929782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-51562339-008b-4f81-bef7-41506b7caf37 req-d3a26666-d01f-4854-a58c-7e47e875aebf service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:58.933516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:58.940545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-51562339-008b-4f81-bef7-41506b7caf37 req-d3a26666-d01f-4854-a58c-7e47e875aebf service nova] Creating event network-changed:54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde for instance b90e80cd-430b-414f-bf31-7641c0490c88 on hv-cinder-80382 Jun 16 00:36:58.945750 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-51562339-008b-4f81-bef7-41506b7caf37 req-d3a26666-d01f-4854-a58c-7e47e875aebf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028228 Jun 16 00:36:58.946339 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 167/320] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:36:59.195282 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-807507713", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dfc603d1-751d-4be9-b4c0-08fa2224635a"}], "security_groups": [{"name": "tempest-securitygroup--1089087809"}], "key_name": "tempest-keypair-886926461", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:36:59.260902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.261639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.268480 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.268971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.269745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.270216 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.299293 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] validate_networks() for [('dfc603d1-751d-4be9-b4c0-08fa2224635a', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:36:59.403235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.412598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d680cce7-bc42-4621-bde8-48acee82c7e9 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.154737 Jun 16 00:36:59.412598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 168/321] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:59.537783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.538405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.545398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.545849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.546616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.547050 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.686243 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.693926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c46730f9-6c08-4338-97c4-672225f26100 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.160172 Jun 16 00:36:59.694747 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 169/322] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:36:59.704869 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:36:59.705392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:36:59.705892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:36:59.706299 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:36:59.706720 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:36:59.716356 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.716839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.717634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.718077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.725929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.726615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.733529 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.734168 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.734986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:36:59.735441 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:36:59.735694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:36:59.739773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Getting quotas for user c9dcfb252f0d44a280b3448094883e13 and project a4e7be42e39248e4b9f5c89e96a6b82e. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:36:59.750864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:36:59.753342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:36:59.864846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.872895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.874404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.875548 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2dca5339-131b-4b3a-905a-92356c2f8569 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.153864 Jun 16 00:36:59.876099 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 170/323] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:36:59.896693 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-111bcfd0-e187-46fd-bd2c-5b5ec8be3e22 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.705521 Jun 16 00:36:59.897330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 154/324] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:36:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:36:59.907731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1696a1c7-72ea-4e87-be9c-0faf7f376ee4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:36:59.908468 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1696a1c7-72ea-4e87-be9c-0faf7f376ee4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:36:59.959348 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1696a1c7-72ea-4e87-be9c-0faf7f376ee4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:36:59.966523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1696a1c7-72ea-4e87-be9c-0faf7f376ee4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1244 microversion: 2.1 time: 0.062561 Jun 16 00:36:59.967079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 171/325] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:36:59 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1244 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:00.428992 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.429596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.437244 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.438183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.439505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.440861 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.570641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:00.578813 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ec5aff94-d50b-4196-a509-e3afee782cd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.154221 Jun 16 00:37:00.579370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 155/326] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:00.710980 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.711644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.718147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.718596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.719363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.719802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.849793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:00.857839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-79acad5e-f0a7-4036-8648-37d163d161ce tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.150714 Jun 16 00:37:00.858399 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 172/327] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:00.894044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.894687 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.900621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.901066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.901809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.902239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.983506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:00.984118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:00.990075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.990518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:00.991277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:00.991713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:01.030294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:01.038345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:01.039908 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:01.041678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-267f29e7-034f-4254-aa3e-6fce8ad516b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.151086 Jun 16 00:37:01.042405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 156/328] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:01.055649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:01.063143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-99bdd254-5a2e-4e77-ad79-fa0227bffb54 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1248 microversion: 2.1 time: 0.083407 Jun 16 00:37:01.063693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 173/329] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:00 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:01.595770 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:01.596385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:01.602459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:01.602905 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:01.603704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:01.604136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:01.875100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:01.875733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:01.882674 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:01.883125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:01.883906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:01.884352 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:01.980425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:01.987696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-73137e28-d17d-4545-a2a2-026637cdeed0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.396461 Jun 16 00:37:01.988458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 157/330] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:01 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:02.013838 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:02.021144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-403dd778-6750-4765-9d0b-a28d82ed6295 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.149935 Jun 16 00:37:02.021690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 174/331] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:01 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:02.059424 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:02.060028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:02.066227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.066672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.067422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.067856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.080257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:02.080887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:02.087080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.087524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.088275 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:02.088734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:02.147525 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:02.155214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cb7633f8-18b5-4a4e-b807-5844ad7b5ca9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1248 microversion: 2.1 time: 0.078981 Jun 16 00:37:02.155774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 175/332] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:02 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:02.195247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:02.203329 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:02.204854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:02.206027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ba01d60b-2a97-49f0-b1bc-a419362e60cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.150931 Jun 16 00:37:02.206582 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 158/333] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:02 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:03.004742 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.005345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.011788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.012236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.013021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.013457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.037691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.038308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.045230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.045682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.046449 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.046954 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.155952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.162860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c8585a2d-ca1b-4036-a26a-b02a35bccaee tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.161906 Jun 16 00:37:03.164580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 176/334] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:02 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:03.172404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.173346 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.180282 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.185633 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.185633 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.185633 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.254030 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.262637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.262888 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ae27654d-d1cf-42b4-9aac-cf1e267792d9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1296 microversion: 2.1 time: 0.094664 Jun 16 00:37:03.263658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 177/335] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:03.267857 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:03.268546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:03.271658 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-54b3b6b9-9d68-489e-93d4-39f1a20ed122 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.237732 Jun 16 00:37:03.272542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 159/336] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:03.277137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.277761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.278542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:03.278975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:03.405390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.413149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.414635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:03.415770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d7cfee83-3a47-4e0e-98a8-e5300f7f7944 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1743 microversion: 2.20 time: 0.151413 Jun 16 00:37:03.416315 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 178/337] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:03 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:04.180882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:04.181484 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:04.187932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.188818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.189662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.190515 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.279902 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:04.280539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:04.287241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.287696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.288473 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.288949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.357535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.365263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-40abc7d7-ff1b-4cc2-83f5-a33e8cb6f421 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1302 microversion: 2.1 time: 0.089757 Jun 16 00:37:04.365827 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 179/338] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:04 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:04.370526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:04.371334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:04.377603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.378042 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.378821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.379260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.381259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.389512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-438b4a72-d374-4e04-aaed-579a0f75ef28 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.212416 Jun 16 00:37:04.390088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 160/339] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:04 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:04.437433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:04.439016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:04.445913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.446512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.447817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:04.448429 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:04.515340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.522777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9a06cfa3-86e6-4b8c-b10a-34bfd740f541 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.155667 Jun 16 00:37:04.523341 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 180/340] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:04 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:04.661748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.670114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.671610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:04.672794 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-171d1fd9-46ec-4315-b184-13188c236241 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1743 microversion: 2.20 time: 0.242849 Jun 16 00:37:04.673344 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 161/341] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:04 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:05.382466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:05.383079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:05.393864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.393864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.393864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.393864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.405562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:05.406176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:05.412401 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.413100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.413891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.414318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.574304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:05.585177 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cfd3d8b8-5d80-4ffc-b981-4a865a6bd9a5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.206452 Jun 16 00:37:05.586171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 181/342] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:05 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:05.594975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:05.596330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:05.607826 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.608441 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.609111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.609535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.662393 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:05.684372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b23a9673-4aa9-4755-8706-9a1145c589ba tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.270119 Jun 16 00:37:05.684372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 162/343] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:05 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:05.690563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-9a460f1e-b148-4f49-b43c-bc4513c115fd req-51605b2f-5304-434b-b519-87c3ddf9e9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac529ee5-1040-4f28-acb9-4346e98dba6d", "name": "network-vif-plugged", "status": "completed", "tag": "1a6c10c9-930f-4464-af5a-19b5b85c5bc2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:05.699865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-9a460f1e-b148-4f49-b43c-bc4513c115fd req-51605b2f-5304-434b-b519-87c3ddf9e9a7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.700915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-9a460f1e-b148-4f49-b43c-bc4513c115fd req-51605b2f-5304-434b-b519-87c3ddf9e9a7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.713367 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-9a460f1e-b148-4f49-b43c-bc4513c115fd req-51605b2f-5304-434b-b519-87c3ddf9e9a7 service nova] Creating event network-vif-plugged:1a6c10c9-930f-4464-af5a-19b5b85c5bc2 for instance ac529ee5-1040-4f28-acb9-4346e98dba6d on hv-cinder-80382 Jun 16 00:37:05.732090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-9a460f1e-b148-4f49-b43c-bc4513c115fd req-51605b2f-5304-434b-b519-87c3ddf9e9a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038387 Jun 16 00:37:05.732090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 163/344] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:05.744809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:05.744809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:05.761608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.762460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.764628 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:05.765600 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:05.879156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:05.890028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-eb6e5a6a-b40c-4370-9225-854f84e61d55 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.303231 Jun 16 00:37:05.890719 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 182/345] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:05 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:06.027603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.035804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.037405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.038498 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-17463662-6c5e-4a4e-a558-e3d741708b47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1743 microversion: 2.20 time: 0.305433 Jun 16 00:37:06.039054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 164/346] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:05 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1743 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:06.583604 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-6b1e27b8-00bc-47d6-856f-3695da70b404 req-429ea6de-1c90-465e-9a8b-6fcbc3aadd64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:06.596419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-6b1e27b8-00bc-47d6-856f-3695da70b404 req-429ea6de-1c90-465e-9a8b-6fcbc3aadd64 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.597076 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-6b1e27b8-00bc-47d6-856f-3695da70b404 req-429ea6de-1c90-465e-9a8b-6fcbc3aadd64 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.606675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:06.607285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:06.614055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.614422 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-6b1e27b8-00bc-47d6-856f-3695da70b404 req-429ea6de-1c90-465e-9a8b-6fcbc3aadd64 service nova] Creating event network-changed:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:37:06.614601 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.615872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.616318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.619219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-6b1e27b8-00bc-47d6-856f-3695da70b404 req-429ea6de-1c90-465e-9a8b-6fcbc3aadd64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040329 Jun 16 00:37:06.619848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 183/347] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:06.622195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:06.694028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:06.695068 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:06.704969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.705642 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.706789 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.707390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.771596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.779921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e3178f52-92aa-4c62-9977-854bb6ebf51d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.178301 Jun 16 00:37:06.780572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 165/348] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:06 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:06.856456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:06.863681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-49081a10-be18-4fe4-b38e-64d34d4edede tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.175735 Jun 16 00:37:06.864236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 184/349] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:06 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:06.906363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:06.906971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:06.913143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.913595 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:06.914354 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:06.914788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.046627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.056069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fa86535c-0e5f-4e1c-af54-71ffea9ca5b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.151833 Jun 16 00:37:07.056663 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 166/350] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:06 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:07.057717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.058444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.064592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.066359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.066359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.066606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.215935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.224517 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.226652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.228097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-497a54a6-16ff-4ae9-a81d-a98c3aef4271 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1743 microversion: 2.20 time: 0.174914 Jun 16 00:37:07.228670 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 185/351] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:07 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:07.750788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-292accbc-887c-41f5-b069-0aa4027b7ca1 req-15f5a287-e3fc-48bc-abff-510443863b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "name": "network-vif-plugged", "status": "completed", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:07.758933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-292accbc-887c-41f5-b069-0aa4027b7ca1 req-15f5a287-e3fc-48bc-abff-510443863b07 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.759384 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-292accbc-887c-41f5-b069-0aa4027b7ca1 req-15f5a287-e3fc-48bc-abff-510443863b07 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.770344 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-292accbc-887c-41f5-b069-0aa4027b7ca1 req-15f5a287-e3fc-48bc-abff-510443863b07 service nova] Creating event network-vif-plugged:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:37:07.775052 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-292accbc-887c-41f5-b069-0aa4027b7ca1 req-15f5a287-e3fc-48bc-abff-510443863b07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028082 Jun 16 00:37:07.776120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 167/352] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:07.797098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.797843 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.804458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.804944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.805709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.806149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.810160 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:07.880966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:07.881620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:07.883523 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:07.889555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.890002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.890758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:07.891188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:07.943617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:07.951498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8080ba2f-08ff-4dc9-82d4-15d374252942 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.158184 Jun 16 00:37:07.952075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 186/353] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:07 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:08.036997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.045062 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d95ad65c-044c-4bda-b6a6-14e878ab48c7 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.168449 Jun 16 00:37:08.045618 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 168/354] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:07 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:08.073501 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:08.074114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:08.080111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.080602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.081374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.081818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.223033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.231365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-45b81bb6-fd13-40f5-ad85-47b94112aea6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1367 microversion: 2.1 time: 0.161448 Jun 16 00:37:08.232571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 187/355] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:08 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:08.247711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:08.248429 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:08.267011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.269503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.273961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.273961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.517308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.533159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.534981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:08.536165 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-93720d58-74e8-4d96-8d8c-0e18237e1934 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.292551 Jun 16 00:37:08.536998 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 169/356] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:08 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:08.971222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:08.971997 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:08.974919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:08.981413 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.983444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:08.984685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:08.985940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.061492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:09.062118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:09.074813 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.075257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.076306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.076929 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.159986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.169601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-90f9b574-2d09-4078-898c-1cca0dc4f7c5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.205652 Jun 16 00:37:09.171193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 188/357] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:08 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:09.249288 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:09.250232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:09.263410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.264071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.267221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.267714 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.309947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.320449 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-07cbd4c9-e79b-4a06-a7b4-d2a0b36875b6 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.262676 Jun 16 00:37:09.321078 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 170/358] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:09 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:09.476450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.491992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e1f3c47a-839d-47f2-8c4d-4496f44bf22b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1557 microversion: 2.1 time: 0.241264 Jun 16 00:37:09.495138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 189/359] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:09 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:09.512901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:09.513459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:09.529825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.530585 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.533313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.534072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.555039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:09.555894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:09.567800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.568180 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.575695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.577264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.679873 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6c356c94-1270-451f-8420-fb4eb55ead56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173510 Jun 16 00:37:09.680568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 171/360] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:37:09 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:09.764541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.775219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.777372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:09.779564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1a5fddd4-6ac5-4b91-b68f-637ffabda6f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.228329 Jun 16 00:37:09.780924 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 190/361] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:09 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:09.798844 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:09.802993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=16 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:09.804214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-86d285fd-fcb1-49e5-8713-51e827778b46 req-0962bdb9-c24e-44a9-bdb6-7a0a256881b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90e80cd-430b-414f-bf31-7641c0490c88", "name": "network-vif-plugged", "status": "completed", "tag": "54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:09.842312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-86d285fd-fcb1-49e5-8713-51e827778b46 req-0962bdb9-c24e-44a9-bdb6-7a0a256881b6 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:09.842633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-86d285fd-fcb1-49e5-8713-51e827778b46 req-0962bdb9-c24e-44a9-bdb6-7a0a256881b6 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:09.873684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-86d285fd-fcb1-49e5-8713-51e827778b46 req-0962bdb9-c24e-44a9-bdb6-7a0a256881b6 service nova] Creating event network-vif-plugged:54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde for instance b90e80cd-430b-414f-bf31-7641c0490c88 on hv-cinder-80382 Jun 16 00:37:09.879608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-86d285fd-fcb1-49e5-8713-51e827778b46 req-0962bdb9-c24e-44a9-bdb6-7a0a256881b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081262 Jun 16 00:37:09.880399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 172/362] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:10.188814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.190546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.223883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:10.254644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.282942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.282942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.282942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.343358 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.344055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.367364 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.368161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.369182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.372412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.586770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:10.605345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3b365544-ed4f-4c3d-baa9-2b37a745d27d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.412194 Jun 16 00:37:10.610476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 191/363] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:10 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:10.806673 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:10.808733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:10.818066 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.820139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.821665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:10.823997 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:10.866005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:10.878291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c95773c2-faac-4983-8c1f-420f7689d9ac tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.541959 Jun 16 00:37:10.879535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 173/364] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:10 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:37:11.105490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.119027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.122835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.127147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0e81ed0d-4a60-4f0b-8437-1e66055932bf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.330271 Jun 16 00:37:11.133250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 192/365] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:10 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:11.618871 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.620051 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.631628 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.632080 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.632902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.633345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.888220 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:11.896865 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:11.897683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:11.924999 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-496d5b84-51b3-4874-aeed-420a2a0fee4d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.311787 Jun 16 00:37:11.927000 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 174/366] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:11 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:11.930308 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.930794 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.935614 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.936141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:11.979287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-5bb278f1-39dd-41b0-ba17-2f710252665e req-b7cf045c-0f38-4b2c-b07f-96eaed16e361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac529ee5-1040-4f28-acb9-4346e98dba6d", "tag": "1a6c10c9-930f-4464-af5a-19b5b85c5bc2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:11.995999 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-5bb278f1-39dd-41b0-ba17-2f710252665e req-b7cf045c-0f38-4b2c-b07f-96eaed16e361 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:11.998286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-5bb278f1-39dd-41b0-ba17-2f710252665e req-b7cf045c-0f38-4b2c-b07f-96eaed16e361 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.060032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-5bb278f1-39dd-41b0-ba17-2f710252665e req-b7cf045c-0f38-4b2c-b07f-96eaed16e361 service nova] Creating event network-changed:1a6c10c9-930f-4464-af5a-19b5b85c5bc2 for instance ac529ee5-1040-4f28-acb9-4346e98dba6d on hv-cinder-80382 Jun 16 00:37:12.085275 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-5bb278f1-39dd-41b0-ba17-2f710252665e req-b7cf045c-0f38-4b2c-b07f-96eaed16e361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114634 Jun 16 00:37:12.092964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 175/367] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:37:12.152586 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:12.153792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:12.163328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.167046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.167046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.167046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.367281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.384815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-669745d6-3ba9-4aec-8ede-a8fc4bd6cfda tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1318 microversion: 2.1 time: 0.484128 Jun 16 00:37:12.387713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 193/368] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:11 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:12.451421 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.457245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.458883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:12.460156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9a55fac5-1825-40ef-a6fb-c15669ea279a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.314674 Jun 16 00:37:12.473859 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 176/369] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:12 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:12.949582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:12.950309 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:12.959349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.960120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:12.961184 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:12.961907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.141897 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.149317 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6759fb6a-34b2-4778-8396-6ef0d88ee62d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.209623 Jun 16 00:37:13.149876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 194/370] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:12 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:13.402886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:13.403536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:13.421900 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.422450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.428902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.428902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.480086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:13.481118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:13.497074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.501698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.501698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:13.501698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:13.730004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.739063 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-12be8285-debe-4a5a-bc45-bbda44a36e1b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1507 microversion: 2.1 time: 0.340595 Jun 16 00:37:13.740045 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 177/371] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:13 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:13.767267 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.801229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.819856 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:13.826976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2c5b15be-eb96-4675-9423-41e5a69cce42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.350878 Jun 16 00:37:13.833900 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 195/372] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:13 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:14.170009 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:14.178110 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:14.183836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.185273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.186436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.187141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.364479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-20fbf09c-068f-4785-81a9-eb9837b3f5d8 req-cd248ce5-0e88-40d8-8635-10966e706a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "name": "network-vif-plugged", "status": "completed", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:14.388319 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-20fbf09c-068f-4785-81a9-eb9837b3f5d8 req-cd248ce5-0e88-40d8-8635-10966e706a79 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.389106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-20fbf09c-068f-4785-81a9-eb9837b3f5d8 req-cd248ce5-0e88-40d8-8635-10966e706a79 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.405775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:14.416127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3fbec752-7a6e-43a5-940b-b10307c0c26b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.250060 Jun 16 00:37:14.417862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 178/373] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:14 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:14.431056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-20fbf09c-068f-4785-81a9-eb9837b3f5d8 req-cd248ce5-0e88-40d8-8635-10966e706a79 service nova] Creating event network-vif-plugged:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:37:14.439672 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-20fbf09c-068f-4785-81a9-eb9837b3f5d8 req-cd248ce5-0e88-40d8-8635-10966e706a79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081649 Jun 16 00:37:14.440941 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 196/374] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:37:14.852887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:14.853273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:14.865901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.866420 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:14.869075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:14.870092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:15.094123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.107924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.110979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.112356 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b61c7ff5-2afc-4066-8188-fd2faabb820c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.268889 Jun 16 00:37:15.114400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 179/375] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:14 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:15.435580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:15.438676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:15.446632 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:15.447502 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:15.448923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:15.449588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:15.604237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:15.613603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-367954ae-fcb3-43b6-9286-7cc899b3eb79 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.184837 Jun 16 00:37:15.614734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 197/376] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:15 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:16.132398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.133682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:16.140513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.141251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:16.142243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.142862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:16.285875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:16.295125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:16.296908 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:16.298057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b7482e37-3c44-4df0-834f-03790c76e01a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.169777 Jun 16 00:37:16.298611 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 180/377] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:16 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:16.631956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:16.632659 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:16.640907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.641452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:16.643799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:16.643799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:16.802546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:16.810423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c0e101f5-2f28-4b33-8908-1ef055b807cb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1370 microversion: 2.1 time: 0.182394 Jun 16 00:37:16.811006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 198/378] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:16 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:17.317077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:17.317686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:17.323671 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:17.324118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.324890 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:17.325314 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.461790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.470794 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.472278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:17.473448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-31e52981-d6b1-4826-a96f-d99184f07819 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.160547 Jun 16 00:37:17.473986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 181/379] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:17 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:17.831070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:17.832257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:17.841697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:17.842154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.842930 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:17.843662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:17.996969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.005159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-13bc8803-8217-4f31-9a2e-464e6de1d5f3 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1563 microversion: 2.1 time: 0.181459 Jun 16 00:37:18.013907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 199/380] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:37:17 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:37:18.027135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:18.027623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:18.036171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.036916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.037985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.038508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.147761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9bd7b2ea-ae5e-4b6d-9bd6-a11454646170 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125097 Jun 16 00:37:18.149838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 182/381] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:37:18 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:18.492279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:18.492931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:18.511708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.512149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.512996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:18.513429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:18.687135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.698026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.700104 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:18.702179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-faaaec56-5772-4dfa-9bd6-6bc64d7234e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.213382 Jun 16 00:37:18.712714 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 200/382] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:18 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:19.519190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-42eb901b-e4a9-47f5-9362-99b1bd12c5f0 req-0f8e2ca8-de50-44c4-8817-8bdd6efab005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:19.530045 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-42eb901b-e4a9-47f5-9362-99b1bd12c5f0 req-0f8e2ca8-de50-44c4-8817-8bdd6efab005 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:19.531277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-42eb901b-e4a9-47f5-9362-99b1bd12c5f0 req-0f8e2ca8-de50-44c4-8817-8bdd6efab005 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:19.560381 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-42eb901b-e4a9-47f5-9362-99b1bd12c5f0 req-0f8e2ca8-de50-44c4-8817-8bdd6efab005 service nova] Creating event network-changed:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:37:19.567985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-42eb901b-e4a9-47f5-9362-99b1bd12c5f0 req-0f8e2ca8-de50-44c4-8817-8bdd6efab005 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052438 Jun 16 00:37:19.571846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 183/383] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:19.722347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:19.725486 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:19.741636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:19.742410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:19.746885 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:19.751202 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:20.164365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.174383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.176588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:20.178081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-00cd2f0b-54d5-4d85-9de9-dc30667a71c5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.461604 Jun 16 00:37:20.179141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 201/384] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:19 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:21.199962 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:21.200879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:21.208265 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:21.208768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:21.209544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:21.209977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:21.355460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.367531 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.369915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:21.371103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-964449d9-bcb2-4596-b33d-a525ff791658 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.177588 Jun 16 00:37:21.371655 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 184/385] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:21 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:22.389829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:22.390474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:22.397181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:22.397581 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:22.398347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:22.398840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:22.541176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:22.549679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:22.551163 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:22.552330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9192507b-143a-4ff8-be86-8b58e8ec84cf tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1738 microversion: 2.20 time: 0.166324 Jun 16 00:37:22.552906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 202/386] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:22 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:23.574293 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:23.574904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:23.581298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:23.588488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:23.588488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:23.588488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:23.588837 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:23.809096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:23.819467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:23.821050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:23.822205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c8028b8c-48bf-41c3-a0d7-fa3fb3788376 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1720 microversion: 2.20 time: 0.252704 Jun 16 00:37:23.822960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 185/387] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:23 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:24.840580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:24.841371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:24.848041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:24.848498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:24.849307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:24.849792 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:24.868576 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=100 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:24.982193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:24.990203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:24.991687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:24.993124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2fe5556f-2800-440c-839d-cf1921fd516b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1720 microversion: 2.20 time: 0.156388 Jun 16 00:37:24.993676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 203/388] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:24 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:26.011015 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:26.011648 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:26.017701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:26.018148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:26.018982 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:26.019347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:26.172345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:26.182960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:26.184624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:26.185881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a3c98c68-9aa8-41f5-abcf-fe921ecb8c20 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1720 microversion: 2.20 time: 0.178822 Jun 16 00:37:26.186835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 186/389] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:26 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:27.205426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:27.205959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:27.212509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:27.212991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:27.213764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:27.214204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:27.349307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:27.357253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:27.358872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:27.360091 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8bd4b55c-ee15-4c93-9be9-f02a61ff6fe7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1723 microversion: 2.20 time: 0.158738 Jun 16 00:37:27.360815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 204/390] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:27 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:27.378245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a3e2784-caf5-42a0-b516-192fc8c1d86c"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:27.379297 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:27.385546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:27.386612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:27.387379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:27.387817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.261071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-be6aa9ca-b312-4267-bdd7-39151f94d2b4 req-4a8b9b78-4752-4df6-a6d2-bdca9700d79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "name": "network-vif-unplugged", "status": "completed", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:28.269246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-be6aa9ca-b312-4267-bdd7-39151f94d2b4 req-4a8b9b78-4752-4df6-a6d2-bdca9700d79f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.269872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-be6aa9ca-b312-4267-bdd7-39151f94d2b4 req-4a8b9b78-4752-4df6-a6d2-bdca9700d79f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.281504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.compute.server_external_events [req-be6aa9ca-b312-4267-bdd7-39151f94d2b4 req-4a8b9b78-4752-4df6-a6d2-bdca9700d79f service nova] Unable to find a host for instance 787e855e-1684-4ea2-aeeb-6e5737f35194. Dropping event network-vif-unplugged {{(pid=124721) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:37:28.282388 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-be6aa9ca-b312-4267-bdd7-39151f94d2b4 req-4a8b9b78-4752-4df6-a6d2-bdca9700d79f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026302 Jun 16 00:37:28.282987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 205/391] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:37:28.377371 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-98b32fc6-171e-4648-ae3d-d88b6eb219d8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.003025 Jun 16 00:37:28.378009 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 187/392] 10.222.0.20 () {62 vars in 1363 bytes} [Thu Jun 16 00:37:27 2022] POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 188 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:37:28.501654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:28.502248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:28.508236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.508820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.509593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.510017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.700432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7950da88-3874-4154-bb9a-95254055b123 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/action" status: 202 len: 0 microversion: 2.20 time: 0.202600 Jun 16 00:37:28.701191 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 206/393] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jun 16 00:37:28 2022] POST /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:37:28.709368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:28.710054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:28.716259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.716739 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.717620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:28.718052 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:28.855357 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:28.863746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:28.865291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:28.866445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-552cf7d6-44a3-4c55-857e-8d28140c04ac tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1749 microversion: 2.20 time: 0.161153 Jun 16 00:37:28.866974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 188/394] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:28 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:29.886585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:29.887196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:29.893302 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.893756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:29.894643 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:29.895087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:30.198920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:30.207291 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:30.208823 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:30.209973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cce25e3d-e3e6-449d-a423-f65516ee6730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1749 microversion: 2.20 time: 0.328309 Jun 16 00:37:30.210516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 207/395] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:29 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1749 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:31.228421 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:31.229107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:31.235705 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:31.236151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:31.236921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:31.237352 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:31.374814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:31.378960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:31.380464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:31.381632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c00f3c78-7584-418d-bbdd-4e13995d6ec8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1751 microversion: 2.20 time: 0.157225 Jun 16 00:37:31.382219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 189/396] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:31 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:32.406200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:32.406761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:32.413199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:32.413646 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:32.414522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:32.414957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:32.551721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:32.560010 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:32.561536 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:32.562683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-11652700-2461-43d8-b769-01c30e7b9575 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.160967 Jun 16 00:37:32.563232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 208/397] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:32 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:33.582641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:33.583147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:33.590342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:33.591090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:33.591849 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:33.592494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:33.763034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:33.771384 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:33.772885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:33.774013 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f72007a8-374d-48e7-bc0f-d36b2630b393 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.196616 Jun 16 00:37:33.774573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 190/398] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:33 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:33.901230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5d9bd0-d7d0-4ac5-9a18-93be3e659d2c", "device": "/dev/sdb"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:33.903381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:33.910850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:33.911571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:33.912550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:33.913008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:34.759537 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d76b644b-262b-4db4-a99b-c37cdf7bc78f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "POST /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861945 Jun 16 00:37:34.760146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 209/399] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:37:33 2022] POST /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:34.792125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:34.792903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:34.799494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:34.800094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:34.800955 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:34.801420 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:34.999762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:35.008808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:35.010391 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:35.012577 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-eeceb31f-fe43-494a-9c6c-22582b8650c4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.224285 Jun 16 00:37:35.013131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 191/400] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:34 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:36.037820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:36.047904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:36.072134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:36.072876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:36.073825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:36.075748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:36.279087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:36.287844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:36.289408 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:36.290599 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c7f61613-286c-4b3c-8ece-50ab6a8fa418 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.263528 Jun 16 00:37:36.291165 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 210/401] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:36 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:37.309183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:37.310011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:37.317346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:37.318060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:37.319028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:37.319691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:37.469596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:37.480398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:37.482221 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:37.483365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e6411371-0cc0-48cc-aa0f-f4f5b5637912 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.178473 Jun 16 00:37:37.484010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 192/402] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:37 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:38.531063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:38.531063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:38.531063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:38.531063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:38.531927 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:38.531927 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:38.674824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:38.684149 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:38.685991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:38.687369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-76f56935-8219-4de2-8332-127d09ad1af1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.188380 Jun 16 00:37:38.688479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 211/403] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:38 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:39.706860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:39.708513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:39.710668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=50 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:39.716210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:39.721120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:39.721120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:39.721120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:39.854892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:39.863770 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:39.865306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:39.866467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ae04e666-1584-47e4-b903-2ff4c1d9be67 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.163919 Jun 16 00:37:39.867137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 193/404] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:39 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:40.887233 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:40.887973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:40.890615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=50 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:40.895489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:40.896008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:40.896894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:40.897397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:41.049134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:41.057918 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:41.059454 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:41.060777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5a7fbabf-0513-4c39-96e5-985729c6b6e0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.177428 Jun 16 00:37:41.061330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 212/405] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:40 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:42.079409 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:42.080134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:42.086653 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:42.087093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:42.087843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:42.088377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:42.240053 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:42.254871 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:42.256959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:42.258140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0404641f-ba9a-41a9-8644-9b8be52d580c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.182850 Jun 16 00:37:42.258704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 194/406] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:42 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:43.276577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:43.281337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:43.289405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:43.289854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:43.290797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:43.291343 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:43.464778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:43.474608 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:43.476325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:43.477661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a665c69a-f76c-49c0-9e16-c0ac91dcfe84 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.205108 Jun 16 00:37:43.478347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 213/407] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:43 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:44.495152 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:44.495892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:44.502517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:44.502973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:44.503733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:44.504169 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:44.656385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:44.665101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:44.666567 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:44.667711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d0032097-3f37-43c5-9060-db659a91c2a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.176425 Jun 16 00:37:44.668283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 195/408] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:44 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:45.686184 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:45.686726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:45.693619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:45.694078 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:45.694860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:45.695301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:45.833301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:45.842117 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:45.843613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:45.844825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1490d80a-f67b-4c29-8e6b-adbeec2e4730 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.162512 Jun 16 00:37:45.845378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 214/409] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:45 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:46.864128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:46.864824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:46.870853 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:46.871299 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:46.872050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:46.872482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:47.016465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:47.024724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:47.026226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:47.027359 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4104df42-22c6-4fc6-b7f1-c199b93454af tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.167160 Jun 16 00:37:47.027910 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 196/410] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:46 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:48.045654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:48.046264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:48.052760 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:48.053212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:48.053970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:48.054407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:48.183314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:48.193164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:48.194666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:48.195818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1f954edb-4dab-48f5-89cd-3603d1600bba tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154069 Jun 16 00:37:48.196375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 215/411] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:48 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:49.214646 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:49.215226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:49.224553 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:49.225020 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:49.225777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:49.226212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:49.354347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:49.364077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:49.365617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:49.366842 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-de4b5d88-d8e2-4119-883d-126d5a6f3e4a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.156080 Jun 16 00:37:49.367381 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 197/412] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:49 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:50.384593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:50.388578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:50.393280 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:50.393736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:50.394515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:50.394957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:50.533166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:50.541566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:50.543057 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:50.544210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-995d1b10-4e80-4482-b7c8-035b3bd36ea2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.163557 Jun 16 00:37:50.544790 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 216/413] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:50 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:51.562987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:51.563634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:51.570073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:51.570521 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:51.571273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:51.571706 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:51.702229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:51.710504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:51.712004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:51.713184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7f0c375d-d501-4f78-8002-d0be3cb5a104 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154687 Jun 16 00:37:51.713736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 198/414] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:51 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:52.731176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:52.731867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:52.738696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:52.739141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:52.739899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:52.740327 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:52.871857 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:52.880830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:52.882325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:52.883472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-68295fb0-65a7-4688-9201-b85e9ad45fab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.156217 Jun 16 00:37:52.884023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 217/415] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:52 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:53.901599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:53.902204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:53.908880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:53.909327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:53.910088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:53.910520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:53.913122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.040120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:54.048623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:54.050162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:54.051305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-79f309da-ce26-438f-813c-ba1794dc688b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.153753 Jun 16 00:37:54.051844 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 199/416] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:53 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:37:55.070375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:55.071220 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:55.078398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:55.078544 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:55.079195 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:55.080243 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:55.083083 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.209709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:55.217838 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:55.219331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:55.220478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8d8adac1-d314-449d-8109-2a1682794b5e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154030 Jun 16 00:37:55.221051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 218/417] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:55 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:56.239623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:56.240225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:56.246202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:56.246650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:56.247397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:56.247831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:56.371128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:56.379950 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:56.393941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:56.393941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3d22824c-0bf2-45bc-8a55-83637e07ac9f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.146818 Jun 16 00:37:56.393941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 200/418] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:56 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:57.410855 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:57.411391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:57.418230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:57.418678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:57.419443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:57.419883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:57.549210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:57.557640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:57.559135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:57.560323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-04d320f2-0cfd-4a7e-877f-054d4ed033f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154221 Jun 16 00:37:57.560938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 219/419] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:57 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:58.578948 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:58.579573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:58.586123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.586579 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.587357 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.587795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.732190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:58.742208 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:58.743728 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:58.744996 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-431eb780-e477-4dea-b2af-1c9adc8260aa tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.170159 Jun 16 00:37:58.745555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 201/420] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:58 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:37:58.796833 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-0b8f55c9-b549-44d6-9abd-451ca3f6d484 req-89a6ec31-bb5e-4b8b-999b-f30896368322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "name": "network-vif-plugged", "status": "completed", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:37:58.805934 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0b8f55c9-b549-44d6-9abd-451ca3f6d484 req-89a6ec31-bb5e-4b8b-999b-f30896368322 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:58.806372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0b8f55c9-b549-44d6-9abd-451ca3f6d484 req-89a6ec31-bb5e-4b8b-999b-f30896368322 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:58.821383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-0b8f55c9-b549-44d6-9abd-451ca3f6d484 req-89a6ec31-bb5e-4b8b-999b-f30896368322 service nova] Creating event network-vif-plugged:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:37:58.822338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-0b8f55c9-b549-44d6-9abd-451ca3f6d484 req-89a6ec31-bb5e-4b8b-999b-f30896368322 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029159 Jun 16 00:37:58.822919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 220/421] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:37:59.762924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:37:59.763557 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:37:59.769653 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:59.770096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:59.770841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:37:59.771322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:37:59.901428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:59.910571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:59.912584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:37:59.913771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-207c3d83-f790-4a15-9ea2-1d2acb123861 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154659 Jun 16 00:37:59.914335 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 202/422] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:37:59 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:00.936105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:00.936828 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:00.943460 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.943941 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:00.944734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:00.945175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:01.073925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:01.082308 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:01.084322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:01.085513 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a3c81e79-b4cb-444e-9651-746aae28cf0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154165 Jun 16 00:38:01.086075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 221/423] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:00 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:02.103468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:02.104075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:02.110011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:02.110462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:02.111214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:02.111651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:02.241878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:02.250321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:02.251821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:02.252990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-443cda6c-4529-4e25-83c5-3ef3814e3ae4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.154000 Jun 16 00:38:02.253688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 203/424] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:02 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:03.272018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:03.272754 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:03.279312 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:03.279765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:03.280539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:03.280991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:03.412080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:03.420432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:03.421974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:03.423110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-88747b1f-b2dc-4466-8fb4-b29c025fd6e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.155677 Jun 16 00:38:03.423649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 222/425] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:03 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:04.442425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:04.443072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:04.449877 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:04.450326 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:04.451073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:04.451506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:04.586966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:04.595355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:04.597183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:04.598028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3f22721e-fb17-4695-a53e-478473dd98f9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.159914 Jun 16 00:38:04.598582 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 204/426] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:04 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:05.615596 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:05.616201 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:05.622724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:05.623173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:05.623932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:05.624372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:05.751099 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:05.759334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:05.760837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:05.761969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2c2c5391-118c-4267-a97c-d515535e2897 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.150275 Jun 16 00:38:05.762518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 223/427] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:05 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:06.163608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:06.164663 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.170621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.171071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.171841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.172295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.199710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-776b882e-8a22-4f35-9028-21f9a3297529 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/ips" status: 200 len: 148 microversion: 2.1 time: 0.039840 Jun 16 00:38:06.200266 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 205/428] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:38:06 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:06.211516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3c1843e-57f9-4da7-8436-cd62402cd480"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:06.212603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.218721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.219167 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.219991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.220432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.297793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: POST /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/os-volume_attachments HTTP/1.1 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 74 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:38:06.299487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {"volumeAttachment": {"volumeId": "e3c1843e-57f9-4da7-8436-cd62402cd480"}} Jun 16 00:38:06.301128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'server_id': 'ac529ee5-1040-4f28-acb9-4346e98dba6d', 'body': {'volumeAttachment': {'volumeId': 'e3c1843e-57f9-4da7-8436-cd62402cd480'}}} Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:06.301981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:06.303137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 400 to user: Invalid volume: volume e3c1843e-57f9-4da7-8436-cd62402cd480 is already attached to instances: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e6368d0b-047d-4d9e-887f-b4bf8cb16b94 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093364 Jun 16 00:38:06.304494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 224/429] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:38:06 2022] POST /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:38:06.309555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:06.310044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.316347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.316823 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.317568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.317997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.342194 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:38:06.634744 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8cfa83f8-9177-4a82-afda-8316cd532eda tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 204 len: 0 microversion: 2.1 time: 0.328620 Jun 16 00:38:06.635330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 206/430] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:38:06 2022] DELETE /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:38:06.643356 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:06.643965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.651970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.652429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.653228 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.653668 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.780975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:06.781753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:06.784359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:06.787971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.788493 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.789268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:06.789870 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:06.791925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-99ad2960-a49d-4020-a4cb-fce46d888e9c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1680 microversion: 2.1 time: 0.152386 Jun 16 00:38:06.792879 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 225/431] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:06 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:06.921783 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:06.930013 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:06.931526 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:06.932685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6902397e-2814-473d-97ff-a56d7be4f76c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.156024 Jun 16 00:38:06.933225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 207/432] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:06 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:38:07.809459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:07.810065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:07.816867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.817316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:07.818074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.818510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:07.955605 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:07.955968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:07.955968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:07.956496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-97dd34f7-e1d8-47f3-883d-75286b6250a9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1680 microversion: 2.1 time: 0.148745 Jun 16 00:38:07.956496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 226/433] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:07 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:07.958365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.958810 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:07.959565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:07.959996 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:08.086848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:08.095303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:08.096831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:08.097953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-58f75149-36ff-4225-aa47-24b8089c5f5f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.150507 Jun 16 00:38:08.098505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 208/434] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:07 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:38:08.971139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:08.971668 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:08.978593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:08.979038 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:08.979794 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:08.980237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:09.104377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:09.111772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bb97603a-76d2-4a62-8e80-6441b949fa4e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1680 microversion: 2.1 time: 0.144571 Jun 16 00:38:09.112497 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 227/435] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:08 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:09.116351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:09.116999 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:09.123545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:09.124015 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:09.124785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:09.125226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:09.254242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:09.263058 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:09.264569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:09.266019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d79bd12b-8d1a-4bbe-8f29-1554c4456484 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.153459 Jun 16 00:38:09.266567 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 209/436] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:09 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:38:10.129456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:10.130060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:10.137246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.137703 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.138472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.138915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.272751 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:10.280186 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8d27d2d6-a3b6-4d9e-9ef1-d4418cc7c88c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1680 microversion: 2.1 time: 0.154579 Jun 16 00:38:10.280923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 228/437] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:10 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:10.284237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:10.286773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:10.286906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:10.291580 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.292035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.292818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:10.293255 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:10.420452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:10.428795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:10.430876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:10.432068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-19ac54f4-93c4-4834-acfe-8e923ea4e8e8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.151786 Jun 16 00:38:10.432700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 210/438] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:10 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:38:11.302360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:11.305862 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:11.306272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=34 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:11.310964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.311505 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:11.312219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.312680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:11.445551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:11.450010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:11.450623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:11.452898 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6060b6a0-2862-4fb3-80e4-252ec771027b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1680 microversion: 2.1 time: 0.154424 Jun 16 00:38:11.453450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 229/439] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:11 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:11.457747 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.458204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:11.458970 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:11.459412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:11.675193 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:11.684006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:11.685617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:11.686840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0f1b2e47-1dd0-4a3a-943b-f0fa3dc03af4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1807 microversion: 2.20 time: 0.240716 Jun 16 00:38:11.687472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 211/440] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:11 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:38:12.471303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:12.471943 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:12.480761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:12.484622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.485577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:12.486741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.521483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-a878294d-7469-43cf-b7a5-c7bda987a662 req-a03f9235-7b21-4315-a04d-86f56f83d50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac529ee5-1040-4f28-acb9-4346e98dba6d", "name": "network-vif-deleted", "tag": "1a6c10c9-930f-4464-af5a-19b5b85c5bc2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:12.542850 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-a878294d-7469-43cf-b7a5-c7bda987a662 req-a03f9235-7b21-4315-a04d-86f56f83d50f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:12.543670 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-a878294d-7469-43cf-b7a5-c7bda987a662 req-a03f9235-7b21-4315-a04d-86f56f83d50f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.584868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-a878294d-7469-43cf-b7a5-c7bda987a662 req-a03f9235-7b21-4315-a04d-86f56f83d50f service nova] Creating event network-vif-deleted:1a6c10c9-930f-4464-af5a-19b5b85c5bc2 for instance ac529ee5-1040-4f28-acb9-4346e98dba6d on hv-cinder-80382 Jun 16 00:38:12.594276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-a878294d-7469-43cf-b7a5-c7bda987a662 req-a03f9235-7b21-4315-a04d-86f56f83d50f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076477 Jun 16 00:38:12.596136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 212/441] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:12.607061 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:12.615589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-81350f60-a59d-4293-89dd-0ee42f14f701 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1612 microversion: 2.1 time: 0.148978 Jun 16 00:38:12.621022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 230/442] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:12 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1612 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:12.706414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:12.707031 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:12.713408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:12.713863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.714629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:12.718005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:12.877805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:12.886922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:12.888417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:12.889906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c462c62e-eaf2-4901-b0ba-2d45ce76b7f5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1794 microversion: 2.20 time: 0.188114 Jun 16 00:38:12.890634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 213/443] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:38:12 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1794 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:38:13.638097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:13.640022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:13.647162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:13.647784 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:13.649740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:13.650398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:13.701709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:13.702390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:13.702955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'fault' on Instance uuid ac529ee5-1040-4f28-acb9-4346e98dba6d {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:13.753131 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:13.762845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0befcf41-e6a1-4de5-be32-5905f2193cdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 200 len: 1331 microversion: 2.1 time: 0.131898 Jun 16 00:38:13.763824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 231/444] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:13 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:14.785141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:14.785636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:14.792391 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.793324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.794266 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.794700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.809607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:14.810142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:38:14.810271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d HTTP/1.1 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:38:14.811548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:38:14.813766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'ac529ee5-1040-4f28-acb9-4346e98dba6d'} Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:38:14.814724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:38:14.816428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:14.817674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:38:14.817674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-37e0aa00-2f80-4550-a66b-fd19b6c8502d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 404 len: 111 microversion: 2.1 time: 0.033070 Jun 16 00:38:14.817674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 214/445] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:14 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:38:14.817867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.817867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.819244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:14.819685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:14.823721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c615b911-b9b1-49df-a5c4-8d4703eb262a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '.version_select at 0x7f2a7b4c1dc0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:14.931570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c615b911-b9b1-49df-a5c4-8d4703eb262a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289509339" status: 202 len: 0 microversion: 2.1 time: 0.107088 Jun 16 00:38:14.931570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 215/446] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:38:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289509339 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:38:14.963290 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lazy-loading 'services' on Instance uuid b90e80cd-430b-414f-bf31-7641c0490c88 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:15.256690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2aa17132-b822-49d5-a950-0bacc5e48961 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88/os-volume_attachments/cb5d9bd0-d7d0-4ac5-9a18-93be3e659d2c" status: 202 len: 0 microversion: 2.1 time: 0.450724 Jun 16 00:38:15.257683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 232/447] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:38:14 2022] DELETE /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88/os-volume_attachments/cb5d9bd0-d7d0-4ac5-9a18-93be3e659d2c => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:38:16.027128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:16.027619 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:16.034263 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.034710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.035468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.035905 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.151142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:16.158405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'services' on Instance uuid fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:16.347593 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f45d621b-c3fd-4872-8c26-65db63ee9a8b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments/e3c1843e-57f9-4da7-8436-cd62402cd480" status: 202 len: 0 microversion: 2.1 time: 0.324672 Jun 16 00:38:16.348374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 216/448] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:38:16 2022] DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments/e3c1843e-57f9-4da7-8436-cd62402cd480 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:38:16.357591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:16.358653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:16.365709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.366163 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.380848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:16.380848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:16.395916 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1c546677-a322-4969-9f4d-abaa73671a72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Jun 16 00:38:16.396506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 233/449] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:16 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:17.407884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:17.409019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:17.415055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.415513 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:17.416268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:17.416730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:17.447463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-dc8c9ee6-d426-4c57-a44e-de11d1a0bfa6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Jun 16 00:38:17.448023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 217/450] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:17 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:18.459141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:18.460063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:18.473959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:18.474417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:18.475190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:18.475626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:18.494140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:18.509612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-31c57309-163a-4b69-9022-a7b06667276d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054453 Jun 16 00:38:18.510243 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 234/451] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:18 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:19.521641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:19.522730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:19.528715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.529384 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.530196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.530634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.550207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:19.550689 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:19.560320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.560797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.561554 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.561981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.562398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9bdbd906-12d0-42c8-b1fd-cf48ad094635 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044521 Jun 16 00:38:19.563067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 218/452] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:19 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:19.587965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:38:19.816216 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d34a830e-1c4d-4a5d-86d4-75312e70b6ec tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 204 len: 0 microversion: 2.1 time: 0.269189 Jun 16 00:38:19.816840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 235/453] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:38:19 2022] DELETE /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:38:19.824809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:19.825445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:19.831522 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.831973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.832789 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:19.833242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:19.961733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:19.969647 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-db9ca3e6-d0dc-4436-b63d-30e990c8c8a5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1513 microversion: 2.1 time: 0.148587 Jun 16 00:38:19.970207 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 219/454] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:19 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:20.580778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:20.581925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:20.588503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:20.588983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:20.589739 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:20.590175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:20.618919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-43689ca1-aad4-496c-ab94-d329e1f466cb tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Jun 16 00:38:20.619968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 236/455] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:20 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:20.987157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:20.987772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:20.993700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:20.994751 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:20.995510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:20.995942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:21.125805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:21.133251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6b75bea0-389f-4228-a67b-93fddbeaf587 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1513 microversion: 2.1 time: 0.149990 Jun 16 00:38:21.133802 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 220/456] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:20 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:21.630335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:21.631283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:21.638345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:21.638796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:21.640788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:21.641239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:21.669774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2344086b-c7c8-4a2f-aa27-2ea9b4cd3b71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043383 Jun 16 00:38:21.670324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 237/457] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:21 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:22.150037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:22.151033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:22.157042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.157641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.158414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.158855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.377273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:22.384697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f8bc1e69-8b9d-4471-9238-c98543174656 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1513 microversion: 2.1 time: 0.238506 Jun 16 00:38:22.385331 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 221/458] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:22 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:22.682713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:22.683866 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:22.690759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.691709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.692627 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.693071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.698114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-b43dfc52-0fe4-46e6-a519-53bd75d54eff req-0aac231b-c14f-47a3-90c3-e3baba6e5912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90e80cd-430b-414f-bf31-7641c0490c88", "name": "network-vif-deleted", "tag": "54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:22.706269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-b43dfc52-0fe4-46e6-a519-53bd75d54eff req-0aac231b-c14f-47a3-90c3-e3baba6e5912 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.706751 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-b43dfc52-0fe4-46e6-a519-53bd75d54eff req-0aac231b-c14f-47a3-90c3-e3baba6e5912 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.720033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-b43dfc52-0fe4-46e6-a519-53bd75d54eff req-0aac231b-c14f-47a3-90c3-e3baba6e5912 service nova] Creating event network-vif-deleted:54ce7cb7-1dd2-41ca-9a4b-a45d1a44bdde for instance b90e80cd-430b-414f-bf31-7641c0490c88 on hv-cinder-80382 Jun 16 00:38:22.722961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4a61410f-ef9b-4189-b80a-9976109d7d82 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045221 Jun 16 00:38:22.727693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 238/459] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:38:22 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:38:22.727916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-b43dfc52-0fe4-46e6-a519-53bd75d54eff req-0aac231b-c14f-47a3-90c3-e3baba6e5912 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Jun 16 00:38:22.727916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 222/460] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:22.781583 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:22.782085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:22.789281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.789731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.790494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:22.791655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:22.817565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:38:23.130967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0549d136-b8e1-4fcd-83e5-7428ae511a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 204 len: 0 microversion: 2.1 time: 0.353450 Jun 16 00:38:23.131717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 239/461] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:38:22 2022] DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:38:23.140913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:23.141599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:23.147672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:23.148330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:23.149115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:23.149548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:23.276166 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:23.283530 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-85866982-3b93-4b0f-a907-92f978b28a84 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1680 microversion: 2.1 time: 0.146769 Jun 16 00:38:23.284076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 223/462] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:23 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:23.402629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:23.403357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:23.409360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:23.409826 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:23.410573 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:23.411007 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:23.441735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:23.442185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:23.442631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lazy-loading 'fault' on Instance uuid b90e80cd-430b-414f-bf31-7641c0490c88 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:23.483644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:23.491212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3e73a34c-14b0-4887-a7db-dc70e9011b3c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1308 microversion: 2.1 time: 0.093347 Jun 16 00:38:23.491774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 240/463] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:23 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:24.299961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:24.300591 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:24.306642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:24.307101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:24.307869 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:24.308363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:24.439644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:24.447861 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-23b7d8fa-2e81-4b8c-b004-dafd12d13535 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1680 microversion: 2.1 time: 0.151725 Jun 16 00:38:24.448465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 224/464] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:24 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:24.514403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:24.515036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:24.521512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:24.521954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:24.522708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:24.523143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:24.557097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:24.557549 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:24.558004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lazy-loading 'fault' on Instance uuid b90e80cd-430b-414f-bf31-7641c0490c88 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:24.602026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:24.609775 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-42d429d0-7af9-40db-a240-120260703d53 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 200 len: 1308 microversion: 2.1 time: 0.099306 Jun 16 00:38:24.610338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 241/465] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:24 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:25.467519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:25.471954 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:25.474753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.475211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.475986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.476424 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.626952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:25.628807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: b90e80cd-430b-414f-bf31-7641c0490c88] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:25.636092 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.636974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.637961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:25.638630 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:25.654571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] HTTP exception thrown: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Request method failure captured: Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 HTTP/1.1 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnsbad2i9IuX8zSY38ALzTsTscTctpf69mPDNc6jEemSI-HGgPUl8UPKDjxa5Xl8itbCrGXLMKI8ZiBiIWXZnR3ML4SACjnCQge9r6xc47BS_7gxCFpOrEPFPNGiUFAqxdc4kd_zwduNrVhcCkOOwDjIon3EIKdHO1yXR2juLeC_XVA Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 213787a3040e45efb2c14f5dd9dcf509 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:38:25.657098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/213787a3040e45efb2c14f5dd9dcf509"}]}] Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 213787a3040e45efb2c14f5dd9dcf509 Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesSnapshotTestJSON-534948220-project Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 6294a11cbb2a475da4864ca15b7959d5 Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesSnapshotTestJSON-534948220-project Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. Jun 16 00:38:25.658368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'b90e80cd-430b-414f-bf31-7641c0490c88'} Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:38:25.659126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. Jun 16 00:38:25.660259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:38:25.661416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Returning 404 to user: Instance b90e80cd-430b-414f-bf31-7641c0490c88 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:38:25.661416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4fce3d4e-b4f9-4720-82c4-ede6d206df19 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88" status: 404 len: 111 microversion: 2.1 time: 0.035403 Jun 16 00:38:25.666767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 242/466] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:25 2022] GET /compute/v2.1/servers/b90e80cd-430b-414f-bf31-7641c0490c88 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:38:25.714307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:25.724065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3399cb3d-7112-4910-857e-c718105f1faf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1680 microversion: 2.1 time: 0.262268 Jun 16 00:38:25.734353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 225/467] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:25 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:26.273070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-ff760978-4623-4761-a389-71b8819e830b req-3b3cd190-82a0-4e68-b1eb-cc756b1e7f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0", "name": "network-vif-deleted", "tag": "29f5f1c3-c98e-4a58-85e1-442189e98eee"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:26.282113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-ff760978-4623-4761-a389-71b8819e830b req-3b3cd190-82a0-4e68-b1eb-cc756b1e7f52 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:26.282530 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-ff760978-4623-4761-a389-71b8819e830b req-3b3cd190-82a0-4e68-b1eb-cc756b1e7f52 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:26.294514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-ff760978-4623-4761-a389-71b8819e830b req-3b3cd190-82a0-4e68-b1eb-cc756b1e7f52 service nova] Creating event network-vif-deleted:29f5f1c3-c98e-4a58-85e1-442189e98eee for instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 on hv-cinder-80382 Jun 16 00:38:26.300098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-ff760978-4623-4761-a389-71b8819e830b req-3b3cd190-82a0-4e68-b1eb-cc756b1e7f52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jun 16 00:38:26.300910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 243/468] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:26.741605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:26.742831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:26.749994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:26.750795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:26.751787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:26.752391 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:26.831409 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:26.842379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2b2f7b32-5db6-487c-b86d-35d8ff53828b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1325 microversion: 2.1 time: 0.104613 Jun 16 00:38:26.843531 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 226/469] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:26 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:27.746923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de76d558-dff2-45c5-862e-852bf4ef0d9e"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:27.747969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:27.754096 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.754544 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.755291 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.755721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.860509 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:27.861140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:27.867057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.867504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.868259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:27.868727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:27.928864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:27.936735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-045db097-6098-4cc0-a0b6-9790f7432324 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1325 microversion: 2.1 time: 0.080075 Jun 16 00:38:27.937285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 227/470] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:27 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1325 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:28.954365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:28.954984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:28.960903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:28.961348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:28.962114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:28.962554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:29.025059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:29.035780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-abff15fd-48df-4295-8947-137c7d41b42a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 200 len: 1325 microversion: 2.1 time: 0.085266 Jun 16 00:38:29.036552 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 228/471] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:28 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 1325 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:29.717840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c8ad4be6-1f37-4774-a06b-e62794dfa378 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.975905 Jun 16 00:38:29.718444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 244/472] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:38:27 2022] POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 194 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:30.052945 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:30.053540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:30.059732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:30.060181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:30.060977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:30.061473 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:30.075776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 HTTP/1.1 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:38:30.077459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:38:30.079161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0'} Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:38:30.080022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:38:30.081736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:38:30.083122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:38:30.083122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2bbfd715-1679-4b5c-a072-9b481109ba89 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 404 len: 111 microversion: 2.1 time: 0.029719 Jun 16 00:38:30.083122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 229/473] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:30 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:38:30.088852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-519e32ce-d43c-45bc-80c7-2e6d5e7ddda1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '.version_select at 0x7f2a7be693a0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:30.142735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-519e32ce-d43c-45bc-80c7-2e6d5e7ddda1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914888608" status: 202 len: 0 microversion: 2.1 time: 0.058631 Jun 16 00:38:30.143272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 245/474] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914888608 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:38:30.959577 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-896b5a3d-4330-4b16-b9de-50410b8ec0b9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: .version_select at 0x7f2a80923670>, body: {"keypair": {"name": "tempest-keypair-730056253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2WW1aDdLVdfG9e/V17ey4gc7kRz9PPDpGvCBkH8ZXSvem66PCMc+6OeFUMIVrXSmERX50jUnJZRrzyfpqaUayeaUob6HJnC1lEVjHsQVEE5TRt6EUQWCyNp/Gw1wfNPw=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:30.974084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-896b5a3d-4330-4b16-b9de-50410b8ec0b9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:30.978107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-896b5a3d-4330-4b16-b9de-50410b8ec0b9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:31.051954 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-896b5a3d-4330-4b16-b9de-50410b8ec0b9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096565 Jun 16 00:38:31.052566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 230/475] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:38:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:33.153890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1789705964", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffe9c59a-3096-4aef-8b2e-e3aa63722c28"}], "security_groups": [{"name": "tempest-securitygroup--1397209419"}], "key_name": "tempest-keypair-730056253", "user_data": "}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:33.253278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] validate_networks() for [('ffe9c59a-3096-4aef-8b2e-e3aa63722c28', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:38:33.608485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:38:33.608952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:38:33.619367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:38:33.619367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:38:33.619367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:38:33.619367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:33.619677 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:33.620232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:33.621368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:33.638588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:33.642539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:33.653905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:38:33.656209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:38:33.772748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ccd0baf7-59e8-4698-9c6c-740643f0afdd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624379 Jun 16 00:38:33.773314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 246/476] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:38:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:38:33.783830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-be85c769-8a32-4369-a007-7f34741827c0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:33.784441 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-be85c769-8a32-4369-a007-7f34741827c0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:33.838370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-be85c769-8a32-4369-a007-7f34741827c0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:33.846608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-be85c769-8a32-4369-a007-7f34741827c0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1241 microversion: 2.1 time: 0.066560 Jun 16 00:38:33.847228 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 231/477] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:33 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:34.864249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:34.864800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:34.872207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:34.872701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:34.873462 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:34.873911 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:34.937793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:34.946582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-00851009-1927-4b6c-b697-5a4e9cab5c7b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1245 microversion: 2.1 time: 0.086745 Jun 16 00:38:34.947154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 247/478] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:34 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:35.075715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1795410442", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "networks": [{"uuid": "03feb970-ecf8-40b0-b2d6-45c5b0cb82d7"}]}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:35.128740 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] validate_networks() for [('03feb970-ecf8-40b0-b2d6-45c5b0cb82d7', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:38:35.476042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:38:35.476481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:38:35.476969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:38:35.477371 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:38:35.477819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:38:35.491351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:35.491823 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:35.492632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:35.493067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:35.510368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Getting quotas for project 213787a3040e45efb2c14f5dd9dcf509. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:38:35.514521 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Getting quotas for user 6294a11cbb2a475da4864ca15b7959d5 and project 213787a3040e45efb2c14f5dd9dcf509. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:38:35.525677 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:38:35.528480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:38:35.733979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-66b7576e-b615-46cb-bfb4-b16992d89c37 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661824 Jun 16 00:38:35.734817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 232/479] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:38:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:38:35.744479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8a4d29c2-4fc3-4493-807f-4303d187a47c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:35.745278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8a4d29c2-4fc3-4493-807f-4303d187a47c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:35.807769 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8a4d29c2-4fc3-4493-807f-4303d187a47c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:35.814495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8a4d29c2-4fc3-4493-807f-4303d187a47c tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1219 microversion: 2.1 time: 0.073742 Jun 16 00:38:35.815976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 248/480] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:35 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:35.963328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:35.964235 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:35.971133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:35.971590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:35.972361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:35.972826 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:36.042698 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:36.050269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d82623d4-b887-4122-ae7e-b9696dd20b33 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1311 microversion: 2.1 time: 0.090972 Jun 16 00:38:36.050852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 233/481] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:35 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:36.832337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:36.833685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:36.840983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:36.841446 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:36.843109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:36.843109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:36.915065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:36.915065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:36.921181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-60bc5738-33fe-4e4c-aa93-e7981a6d487f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1223 microversion: 2.1 time: 0.092636 Jun 16 00:38:36.921907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 249/482] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:36 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:37.067483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:37.068086 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:37.074431 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.074880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.075667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.076103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.265218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:37.267682 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:37.274433 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.275213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.276243 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.276931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.306432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'flavor' on Instance uuid 4b06a62e-3a82-4a98-b470-cdc82179df7b {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:37.343700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:37.351610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-112ac651-10fe-4ced-844a-b4d696cd66cf tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.288216 Jun 16 00:38:37.352973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 234/483] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:37 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:37.568756 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-e7815857-b90c-4cd7-adc2-d4e3e1db638a req-af681f0e-7df3-4ca4-9854-81908af26a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9783fec-706a-4ed8-96b9-b5d790347dc8", "tag": "d19ee40c-ad48-4dc4-be4e-bfe79a861aa1"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:37.582563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-e7815857-b90c-4cd7-adc2-d4e3e1db638a req-af681f0e-7df3-4ca4-9854-81908af26a64 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.583287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-e7815857-b90c-4cd7-adc2-d4e3e1db638a req-af681f0e-7df3-4ca4-9854-81908af26a64 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.596124 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-e7815857-b90c-4cd7-adc2-d4e3e1db638a req-af681f0e-7df3-4ca4-9854-81908af26a64 service nova] Creating event network-changed:d19ee40c-ad48-4dc4-be4e-bfe79a861aa1 for instance c9783fec-706a-4ed8-96b9-b5d790347dc8 on hv-cinder-80382 Jun 16 00:38:37.601283 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-e7815857-b90c-4cd7-adc2-d4e3e1db638a req-af681f0e-7df3-4ca4-9854-81908af26a64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036824 Jun 16 00:38:37.601881 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 235/484] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:37.615854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1891f405-9b38-450d-8115-38caf449a0de tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/action" status: 200 len: 32 microversion: 2.1 time: 0.355113 Jun 16 00:38:37.616888 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 250/485] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:38:37 2022] POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:38:37.629039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:37.629304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:37.635882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.636480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.637917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.638355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.892738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:37.901093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-72eeb6da-ca87-4933-8e03-f409fc2d1671 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.277007 Jun 16 00:38:37.901754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 236/486] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:37 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:37.940211 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:37.945186 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:37.948095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.948567 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:37.949936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:37.950375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.011072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:38.019653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-449d26d3-15f3-4c4c-9b5a-d0d5e5686f15 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1279 microversion: 2.1 time: 0.084811 Jun 16 00:38:38.020271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 251/487] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:37 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:38.369083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:38.369684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:38.376220 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.376710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.377470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.377903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.393678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:38.671708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:38.678959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4171c1cf-75f0-438c-9b1c-41bde63a3a71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.313730 Jun 16 00:38:38.679524 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 237/488] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:38 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:38.920146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:38.920787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:38.927227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.927674 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:38.928591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:38.929029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.038550 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:39.039174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:39.045688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.046209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.047560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.048259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.066762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:39.076039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7ddda648-a3b6-4f7c-9401-155bd298f1dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.161061 Jun 16 00:38:39.076829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 252/489] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:38 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:39.203742 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:39.211149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-de0fe3f9-3b0d-4f73-83e1-96379385b12d tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1277 microversion: 2.1 time: 0.176914 Jun 16 00:38:39.212269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 238/490] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:39 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:39.695827 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:39.696447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:39.702983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.703424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.704179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:39.704633 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:39.832326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:39.839687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b8c5b528-9cae-4d4e-b2ba-a0a40b3e8de0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.147767 Jun 16 00:38:39.840889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 253/491] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:39 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:40.093870 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:40.094477 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:40.100414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.100904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.101660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.102094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.228115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:40.228841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:40.231362 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:40.236019 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.236470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.237261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.237689 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.239607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-26d6836f-e71c-47b2-872a-34d3e2f1160d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.150074 Jun 16 00:38:40.240167 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 239/492] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:40 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:40.363638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:40.370987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0ecede7a-0328-483c-baa1-1e87138f80fc tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.146662 Jun 16 00:38:40.372169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 254/493] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:40 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:40.857766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:40.864834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:40.864834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.864834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:40.865581 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:40.866026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.067904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:41.075149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-599b7958-2fec-496e-83d6-cb91743f0966 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.221834 Jun 16 00:38:41.075704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 240/494] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:40 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:38:41.256113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:41.256972 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:41.264926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.265389 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.266186 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.266621 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.388453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:41.389869 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:41.394697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:41.397445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.397899 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.399382 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.399831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.403652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1e106f95-5e2d-4362-befd-e6d3b88eb084 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.151349 Jun 16 00:38:41.413619 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 255/495] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:41 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:41.424144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-b9aa4e58-e795-4494-bbca-8128cd7983a7 req-97ec2634-1691-4b5d-9d77-77fdcfa65e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369b3bf-9cb7-44f5-87fc-ccb4290aee4e", "tag": "a061b975-29ef-466b-868b-b3a82091bb69"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:41.432885 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-b9aa4e58-e795-4494-bbca-8128cd7983a7 req-97ec2634-1691-4b5d-9d77-77fdcfa65e01 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:41.434301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-b9aa4e58-e795-4494-bbca-8128cd7983a7 req-97ec2634-1691-4b5d-9d77-77fdcfa65e01 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:41.446516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-b9aa4e58-e795-4494-bbca-8128cd7983a7 req-97ec2634-1691-4b5d-9d77-77fdcfa65e01 service nova] Creating event network-changed:a061b975-29ef-466b-868b-b3a82091bb69 for instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e on hv-cinder-80382 Jun 16 00:38:41.451974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-b9aa4e58-e795-4494-bbca-8128cd7983a7 req-97ec2634-1691-4b5d-9d77-77fdcfa65e01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032675 Jun 16 00:38:41.452665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 256/496] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:41.594847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:41.604122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-24d7593f-f90b-4efa-8f65-8b5b25420191 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.220082 Jun 16 00:38:41.604998 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 241/497] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:41 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:42.092106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:42.092908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:42.094949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:42.099919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.105283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.105283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.105283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.237158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:42.244733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ce2ad056-f933-4e81-9761-3d253587ae83 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.156875 Jun 16 00:38:42.245503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 257/498] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:42 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:42.421764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:42.422292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:42.424108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:42.428840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.429289 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.430108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.430542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.556442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:42.564306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-dd403631-f93b-48d0-80d2-4738a5471a5c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.147229 Jun 16 00:38:42.564898 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 242/499] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:42 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:42.620890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:42.621503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:42.627964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.628417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.629209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:42.629650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:42.759194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:42.766989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7619303c-647a-45a2-b0f9-787bc4bbb4b2 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.150268 Jun 16 00:38:42.767542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 258/500] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:42 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:43.261198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:43.262437 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:43.268295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.268775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.269530 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.269960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.433358 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:43.441985 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6e9840e1-48b8-441b-a2d6-a930862ccbcd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.184566 Jun 16 00:38:43.443046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 243/501] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:43 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:43.583660 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:43.584494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:43.591747 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.592409 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.593416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.594022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.628955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:43.740494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:43.750237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b81b45ee-7c77-4636-bbe6-dfd3ac678ec9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.172238 Jun 16 00:38:43.751065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 259/502] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:43 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:43.784361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:43.785304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:43.792708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.792708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.793989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.794432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.925572 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-bb38b868-6527-4b49-b7b8-2c0ad8aebd71 req-efa4a4a8-1773-472c-9898-4d130269f6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9783fec-706a-4ed8-96b9-b5d790347dc8", "name": "network-vif-plugged", "status": "completed", "tag": "d19ee40c-ad48-4dc4-be4e-bfe79a861aa1"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:43.935916 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-bb38b868-6527-4b49-b7b8-2c0ad8aebd71 req-efa4a4a8-1773-472c-9898-4d130269f6d9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:43.939206 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-bb38b868-6527-4b49-b7b8-2c0ad8aebd71 req-efa4a4a8-1773-472c-9898-4d130269f6d9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:43.948610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-bb38b868-6527-4b49-b7b8-2c0ad8aebd71 req-efa4a4a8-1773-472c-9898-4d130269f6d9 service nova] Creating event network-vif-plugged:d19ee40c-ad48-4dc4-be4e-bfe79a861aa1 for instance c9783fec-706a-4ed8-96b9-b5d790347dc8 on hv-cinder-80382 Jun 16 00:38:43.954118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-bb38b868-6527-4b49-b7b8-2c0ad8aebd71 req-efa4a4a8-1773-472c-9898-4d130269f6d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033968 Jun 16 00:38:43.954890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 260/503] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:44.018370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:44.033596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7b934e1d-269f-4811-a3cd-4e57e69b596a tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.253567 Jun 16 00:38:44.034633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 244/504] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:43 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:44.459252 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:44.460197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:44.467045 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:44.467491 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:44.468245 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:44.468757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:44.597892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:44.605986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-45a9e1c9-096f-41a0-a573-8ffa0ac323d7 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.150475 Jun 16 00:38:44.606545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 261/505] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:44 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:44.768868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:44.769382 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:44.775340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:44.775785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:44.776559 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:44.776996 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:44.900970 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:44.909486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6d6b4df4-7767-4bb2-aca8-b00c2aa33fdb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.144831 Jun 16 00:38:44.910045 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 245/506] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:44 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:45.055516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:45.056203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:45.067711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.068162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.068971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.069416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.198110 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:45.206049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-25d55e90-1256-4287-81ee-5167c0b082c5 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.154787 Jun 16 00:38:45.206606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 262/507] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:45 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:45.623036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:45.623648 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:45.625511 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:45.626197 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=12 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:45.631313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.638140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.638140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.638140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.758596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:45.766578 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4c860bfc-b62f-4421-a1b6-cc879bcc6a2a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1367 microversion: 2.1 time: 0.147537 Jun 16 00:38:45.767231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 246/508] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:45 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:45.926733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:45.927334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:45.929331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=8 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:45.934822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.935275 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.938655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.938655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.974630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-92d643a7-539c-45b9-a0e4-b02b382ff905 req-55f31c49-5308-4af0-aa7d-b7ed628a5a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369b3bf-9cb7-44f5-87fc-ccb4290aee4e", "name": "network-vif-plugged", "status": "completed", "tag": "a061b975-29ef-466b-868b-b3a82091bb69"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:45.983623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-92d643a7-539c-45b9-a0e4-b02b382ff905 req-55f31c49-5308-4af0-aa7d-b7ed628a5a4b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:45.984056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-92d643a7-539c-45b9-a0e4-b02b382ff905 req-55f31c49-5308-4af0-aa7d-b7ed628a5a4b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:45.995087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-92d643a7-539c-45b9-a0e4-b02b382ff905 req-55f31c49-5308-4af0-aa7d-b7ed628a5a4b service nova] Creating event network-vif-plugged:a061b975-29ef-466b-868b-b3a82091bb69 for instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e on hv-cinder-80382 Jun 16 00:38:46.000415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-92d643a7-539c-45b9-a0e4-b02b382ff905 req-55f31c49-5308-4af0-aa7d-b7ed628a5a4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029708 Jun 16 00:38:46.001075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 247/509] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:38:46.078776 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:46.087453 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-baf8c04e-62a2-4102-865c-fe8413acf040 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.164674 Jun 16 00:38:46.088107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 263/510] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:45 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:46.222298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:46.222993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:46.229616 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.230069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:46.230836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.231308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:46.368654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:46.376730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c200a06c-52e8-4c8d-a0dd-a31315de62bd tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.158604 Jun 16 00:38:46.377282 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 248/511] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:46 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:46.783128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:46.783736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:46.789761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.790208 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:46.790994 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.791437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:46.920912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:46.928331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-747d922c-1b07-4b8c-9f15-fc0f06b0887d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1558 microversion: 2.1 time: 0.149032 Jun 16 00:38:46.928914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 264/512] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:46 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:46.948829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:46.950037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:46.959967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.960417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:46.961227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:46.961657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:47.064577 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-70d33d8a-bfbe-4084-b3d6-0eeec0086c72 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119770 Jun 16 00:38:47.065230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 249/513] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:38:46 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:47.104545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:47.105886 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:47.112507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:47.112981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:47.113738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:47.114199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:47.242059 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:47.246857 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:47.253340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-164648f9-8f64-473f-bda1-a130d024d151 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.152613 Jun 16 00:38:47.253916 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 265/514] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:47 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:47.393639 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:47.394247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:47.400195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:47.400689 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:47.401444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:47.401885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:47.597361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:47.603906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1f1ad509-d45d-4521-beaa-6dc17e63dfd3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.214230 Jun 16 00:38:47.604455 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 250/515] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:47 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:48.044066 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-e24e5830-3eb8-4acd-b8d9-7592d6a25766 req-b7d99405-5570-4717-80b1-8aa01005d89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9783fec-706a-4ed8-96b9-b5d790347dc8", "tag": "d19ee40c-ad48-4dc4-be4e-bfe79a861aa1"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:48.052707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-e24e5830-3eb8-4acd-b8d9-7592d6a25766 req-b7d99405-5570-4717-80b1-8aa01005d89d service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:48.053150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-e24e5830-3eb8-4acd-b8d9-7592d6a25766 req-b7d99405-5570-4717-80b1-8aa01005d89d service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:48.064690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-e24e5830-3eb8-4acd-b8d9-7592d6a25766 req-b7d99405-5570-4717-80b1-8aa01005d89d service nova] Creating event network-changed:d19ee40c-ad48-4dc4-be4e-bfe79a861aa1 for instance c9783fec-706a-4ed8-96b9-b5d790347dc8 on hv-cinder-80382 Jun 16 00:38:48.069865 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-e24e5830-3eb8-4acd-b8d9-7592d6a25766 req-b7d99405-5570-4717-80b1-8aa01005d89d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029368 Jun 16 00:38:48.070684 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 266/516] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:48.270594 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:48.271335 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:48.277497 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:48.278098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:48.278869 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:48.279305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:48.410008 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:48.417920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-541ee46e-7fd2-4e1d-9940-d9d9dcdf4516 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.151237 Jun 16 00:38:48.418481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 251/517] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:48 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:48.622984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:48.623765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:48.630194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:48.630649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:48.631407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:48.631839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:48.765531 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:48.772987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3b49d39d-d1ba-4503-a5df-39c77610f444 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1319 microversion: 2.1 time: 0.155527 Jun 16 00:38:48.773544 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 267/518] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:48 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:49.434576 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:49.435095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:49.441047 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.441758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.442512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.442936 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.569486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:49.578128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-81e05edb-c6ec-4570-8669-b9b572ae0da1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.147569 Jun 16 00:38:49.578732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 252/519] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:49 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:49.788822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:49.789439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:49.796787 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.797240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.798299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.798833 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.924359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:49.931745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8cdfea3b-22e3-4445-b712-691468123c38 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1509 microversion: 2.1 time: 0.146756 Jun 16 00:38:49.932291 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 268/520] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:49 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:49.948269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2bebf4b-af49-48bc-86a7-42bedc476aaa", "device": "/dev/sdb"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:38:49.950491 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:49.956692 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.957137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:49.957887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:49.958316 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:50.531672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:50.595848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:50.596977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:50.602697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:50.607021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:50.607021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:50.607021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:50.631656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-28ba4591-5770-4d2c-9a72-351edcd7bebe tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "POST /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687018 Jun 16 00:38:50.635785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 253/521] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:38:49 2022] POST /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:38:50.741432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:50.749702 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9cb5025c-d36b-4dfa-af0d-388effd09be0 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.157767 Jun 16 00:38:50.750134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 269/522] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:50 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:51.767535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:51.768233 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:51.774897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:51.775348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:51.776101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:51.776561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:51.906098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:51.913931 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e2564e9b-9d7a-4750-a0dd-1b59de7975db tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.150995 Jun 16 00:38:51.914491 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 254/523] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:51 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:52.931435 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:52.931977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:52.938520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:52.938975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:52.939738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:52.940177 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:53.068272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:53.076568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-873e9c2c-f5fb-4fde-8d5e-8cb337c0941d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.149093 Jun 16 00:38:53.077126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 270/524] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:52 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:54.093531 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:54.094071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:54.097796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:54.098358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:54.100630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.101084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.101856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.102291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.105843 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.106292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.107047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.107476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.136315 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2234737c-1166-4d26-8442-ec7df1dede11 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments/3a3e2784-caf5-42a0-b516-192fc8c1d86c" status: 200 len: 194 microversion: 2.20 time: 0.042531 Jun 16 00:38:54.137027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 271/525] 10.222.0.20 () {60 vars in 1453 bytes} [Thu Jun 16 00:38:54 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments/3a3e2784-caf5-42a0-b516-192fc8c1d86c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:38:54.200571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:54.201070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:54.206966 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.207414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.208174 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.208640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.231084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:54.239271 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2f214e67-9f99-45f1-8ad5-b72a7da71a87 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.149672 Jun 16 00:38:54.239847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 255/526] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:54 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:54.286778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lazy-loading 'services' on Instance uuid 787e855e-1684-4ea2-aeeb-6e5737f35194 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:38:54.558183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8c7488c6-0a7a-440d-810d-45bdc4690737 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments/3a3e2784-caf5-42a0-b516-192fc8c1d86c" status: 202 len: 0 microversion: 2.20 time: 0.361408 Jun 16 00:38:54.559399 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 272/527] 10.222.0.20 () {60 vars in 1456 bytes} [Thu Jun 16 00:38:54 2022] DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments/3a3e2784-caf5-42a0-b516-192fc8c1d86c => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:38:54.567849 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:54.568884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:54.574884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.575340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.576106 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:54.576573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:54.606745 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ceb79b0a-b3a9-4c30-af71-23dd93d44da0 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043021 Jun 16 00:38:54.607305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 256/528] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:54 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:38:55.257887 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:55.258585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:55.265391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.265845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.266601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.267039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.391316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:55.399143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5e8bff06-f67b-4bbd-8ab3-f030342f25b8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.145956 Jun 16 00:38:55.399687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 273/529] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:55 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:55.618516 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:55.619470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:55.628269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.628755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.629512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:55.629941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:55.659839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-296bb32b-49f5-432c-84b8-34d3457732db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045197 Jun 16 00:38:55.660386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 257/530] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:55 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:38:56.417182 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:56.418338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:56.425434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.425929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:56.426669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.427104 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:56.556915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:56.564802 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7930a79d-3dc4-4ac0-8c32-82a74fef6ace tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.151988 Jun 16 00:38:56.565352 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 274/531] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:56 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:56.672020 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:56.672898 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:56.679398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.679856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:56.680636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:56.681073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:56.709423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4145d1cd-151f-4820-9472-6cfe179f0026 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042072 Jun 16 00:38:56.710033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 258/532] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:56 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:38:57.581945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:57.582575 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:57.589060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:57.589511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:57.590290 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:57.590724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:57.720937 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:57.721470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:57.722395 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:57.728855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:57.729146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-979313ec-5c38-4aee-8edb-f9231615571a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.151014 Jun 16 00:38:57.729307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:57.729704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 275/533] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:57 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:57.730669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:57.731231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:57.760023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-82335d1d-5930-4816-b7fe-7c714c8b6da4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042594 Jun 16 00:38:57.760589 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 259/534] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:57 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:38:58.746591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:58.747192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:58.753535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.753976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.754723 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.755150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.771323 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:58.772242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:58.779079 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.779526 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.780285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:58.780750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:58.810133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a2f840b3-766e-49aa-aec4-6d166ec77131 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042686 Jun 16 00:38:58.810690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 260/535] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:58 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 00:38:58.882822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:38:58.890588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e0757979-114b-4563-92a5-86caea920613 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.147792 Jun 16 00:38:58.891141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 276/536] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:58 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:59.821909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:59.822829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:59.829392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.829847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.830615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.831047 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.859494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8c78160f-1e09-45de-b3ed-32f7061ef4f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041483 Jun 16 00:38:59.860045 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 261/537] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:38:59 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:38:59.907075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:59.907764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:59.914712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.915263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.916118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.916647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.917302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:38:59.918310 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:38:59.924776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.924776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.925374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:38:59.925803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:38:59.950745 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:00.050244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:00.058178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7a79d5d2-b170-4e60-a3f1-208e80a6a986 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.154865 Jun 16 00:39:00.058740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 277/538] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:38:59 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:00.181627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1318d9fa-6485-4f49-84aa-18467ada7bc2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 204 len: 0 microversion: 2.20 time: 0.267851 Jun 16 00:39:00.182224 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 262/539] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jun 16 00:38:59 2022] DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 00:39:00.190732 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:00.191336 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:00.197713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:00.198168 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:00.198914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:00.199910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:00.322541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:00.331004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:00.332515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:00.333679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1533d24c-29f2-4738-a9c8-b21dfcbf1f03 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.146784 Jun 16 00:39:00.334226 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 278/540] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:00 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:01.076570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:01.077260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:01.083664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.084108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.084886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.085338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.210755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:01.218610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1133d6f5-dc5a-4daa-843e-197dc6524282 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.146996 Jun 16 00:39:01.219173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 263/541] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:01 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:39:01.351266 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:01.351804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:01.358263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.358709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.359466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:01.359903 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:01.489483 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:01.497264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:01.498756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:01.499897 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-031182de-33be-4dcf-bc77-7335238829dc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.152554 Jun 16 00:39:01.500452 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 279/542] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:01 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:02.235973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:02.236595 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:02.243073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.243518 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.244259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.244723 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.374676 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:02.382415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5064da9e-5997-4ee2-99a4-97d08b4432a7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.150264 Jun 16 00:39:02.382969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 264/543] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:02 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:02.517772 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:02.518377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:02.524881 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.525332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.526093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:02.526524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:02.652865 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:02.660824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:02.662301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:02.663433 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7d70659c-daa5-47cf-be10-50f0b7caa102 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.149594 Jun 16 00:39:02.663967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 280/544] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:02 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:03.405446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:03.406056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:03.412706 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.413159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.413973 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.414411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.539260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:03.547595 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1a5bb439-bc07-4a0d-abc9-7ed921d4383c tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.145999 Jun 16 00:39:03.548154 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 265/545] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:03 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:03.681726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:03.682383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:03.689124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.689571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.690326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:03.690761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:03.988890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:03.996860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:03.998347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:03.999485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0519b2f5-3bb2-4ac2-a24f-e0798644f11e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.321676 Jun 16 00:39:04.000029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 281/546] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:03 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:04.564264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:04.564891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:04.571490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:04.571938 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:04.572729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:04.573164 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:04.705572 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:04.713296 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9c59e4bd-1a5b-4256-95ef-7f39a2e6e96e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.152856 Jun 16 00:39:04.713849 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 266/547] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:04 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:05.018073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:05.018673 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:05.025330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.030652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.030652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.030652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.043372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:05.156105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:05.163986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:05.165533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:05.166711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-abd81487-5fd7-475c-97ec-a6729b6bf8ec tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.152515 Jun 16 00:39:05.167267 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 282/548] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:05 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:05.729757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:05.731011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:05.737418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.737862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.738825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:05.739260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:05.864068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:05.871987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-03c93610-7376-4597-b045-7df1c96848f5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.146072 Jun 16 00:39:05.872559 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 267/549] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:05 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:06.184232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:06.184867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:06.191995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.192443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:06.193235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.193668 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:06.326440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:06.334391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:06.335899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:06.337121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7d1d20eb-6b4c-4d55-903f-8e90837f1d50 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.156843 Jun 16 00:39:06.337672 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 283/550] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:06 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:06.888641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:06.889225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:06.895655 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.896110 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:06.896893 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:06.897328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:07.028492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:07.030775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:07.037027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d1dd0bf4-8387-42f6-b8b0-61c6cac21664 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.152324 Jun 16 00:39:07.037605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 268/551] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:06 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:07.358294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:07.358899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:07.365431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:07.365883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:07.366645 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:07.367079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:07.493334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:07.501231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:07.502733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:07.503905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1541fbdc-c825-45c8-89bd-ed45ebdd93a4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.152502 Jun 16 00:39:07.504457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 284/552] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:07 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:08.054707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:08.055321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:08.063019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.063466 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.064217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.064672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.190154 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:08.198336 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6f21dc7a-ecac-4168-b9f9-9b9d0111a14f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1734 microversion: 2.1 time: 0.147472 Jun 16 00:39:08.198927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 269/553] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:08 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:08.522611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:08.523252 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:08.530440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.530889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.531741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:08.532173 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:08.668281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:08.676590 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:08.678182 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:08.679414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4a0afd5a-2b49-44b3-9c28-864c916089a1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1722 microversion: 2.20 time: 0.160936 Jun 16 00:39:08.680050 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 285/554] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:08 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:09.156309 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-21d3f674-f889-44fe-b01f-b59d31ecd6bd req-e02ac011-e8dd-4739-b4b4-def2232a068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787e855e-1684-4ea2-aeeb-6e5737f35194", "name": "network-vif-deleted", "tag": "887c04b4-2d9e-4578-ae6e-a8075049b4fa"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:09.160302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-21d3f674-f889-44fe-b01f-b59d31ecd6bd req-e02ac011-e8dd-4739-b4b4-def2232a068f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.160827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-21d3f674-f889-44fe-b01f-b59d31ecd6bd req-e02ac011-e8dd-4739-b4b4-def2232a068f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.185727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-21d3f674-f889-44fe-b01f-b59d31ecd6bd req-e02ac011-e8dd-4739-b4b4-def2232a068f service nova] Creating event network-vif-deleted:887c04b4-2d9e-4578-ae6e-a8075049b4fa for instance 787e855e-1684-4ea2-aeeb-6e5737f35194 on hv-cinder-80382 Jun 16 00:39:09.190769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-21d3f674-f889-44fe-b01f-b59d31ecd6bd req-e02ac011-e8dd-4739-b4b4-def2232a068f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042978 Jun 16 00:39:09.191612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 270/555] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:09.215667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:09.216278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.222821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.223268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.224031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.224461 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.393145 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:09.403440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-669ab07f-7ad5-41ac-bce4-e746516ad5f1 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1714 microversion: 2.1 time: 0.191173 Jun 16 00:39:09.422562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 286/556] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:09 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1714 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:09.524652 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:09.525242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.531958 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.532424 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.533309 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.533754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] HTTP exception thrown: Cannot 'detach_volume' instance 4b06a62e-3a82-4a98-b470-cdc82179df7b while it is in vm_state rescued Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Request method failure captured: Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments/de76d558-dff2-45c5-862e-852bf4ef0d9e HTTP/1.1 Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqut7v3ybWuAnrqMcwjd_4c8R3L_IH68MNR5jafHKKTh49sm50FoSRXqCiOJobjLW9BpA0h-S7ruzCdwqpL0kg0NFc04RbG98gNfkfCDCcFZL5PdzyZLcWBQRXTM5kWwv4_cCdovYl8vuA3s9obwbYWEaTzMAWMbiX5JyZOrCAOw8g Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:39:09.643191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}] Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: c9dcfb252f0d44a280b3448094883e13 Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:39:09.644969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Cannot 'detach_volume' instance 4b06a62e-3a82-4a98-b470-cdc82179df7b while it is in vm_state rescued Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'server_id': '4b06a62e-3a82-4a98-b470-cdc82179df7b', 'id': 'de76d558-dff2-45c5-862e-852bf4ef0d9e'} Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:09.645771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4b06a62e-3a82-4a98-b470-cdc82179df7b while it is in vm_state rescued Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4b06a62e-3a82-4a98-b470-cdc82179df7b while it is in vm_state rescued Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:09.647210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Returning 409 to user: Cannot 'detach_volume' instance 4b06a62e-3a82-4a98-b470-cdc82179df7b while it is in vm_state rescued {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:09.649318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1fd18663-fbbd-4d04-b606-2bd0f955c0dd tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments/de76d558-dff2-45c5-862e-852bf4ef0d9e" status: 409 len: 152 microversion: 2.1 time: 0.129209 Jun 16 00:39:09.649864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 271/557] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:39:09 2022] DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments/de76d558-dff2-45c5-862e-852bf4ef0d9e => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 00:39:09.658310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:09.658836 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.665514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.672002 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.672002 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.672002 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.697227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:09.697863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.705036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.705485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.706251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.706678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.739026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.739468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.739941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lazy-loading 'fault' on Instance uuid 787e855e-1684-4ea2-aeeb-6e5737f35194 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:09.782429 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:09.790691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:09.792181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:09.793856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b5c6fee2-49ae-44c0-83e6-bc5c2db1f223 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 200 len: 1370 microversion: 2.20 time: 0.100495 Jun 16 00:39:09.794397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 272/558] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:09 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:39:09.888423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0def065c-0469-4c94-ac89-9a5963cf9988 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/action" status: 202 len: 0 microversion: 2.1 time: 0.233879 Jun 16 00:39:09.889552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 287/559] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:39:09 2022] POST /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:39:09.897958 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:09.898814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:09.905574 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.906023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:09.906779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:09.907212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:10.048118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:10.056091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-47541f22-6595-47e6-84c8-303f485d43d4 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1722 microversion: 2.1 time: 0.162139 Jun 16 00:39:10.056737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 273/560] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:09 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:10.813788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:10.814486 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:10.821215 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:10.821664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:10.822423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:10.822859 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:10.837187 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 HTTP/1.1 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:39:10.838819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:39:10.840455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '787e855e-1684-4ea2-aeeb-6e5737f35194'} Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:10.841426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:39:10.842864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:10.844919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:10.844919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a3305e37-9c65-48d7-9f0f-79725165192a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 404 len: 111 microversion: 2.20 time: 0.031812 Jun 16 00:39:10.844919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 288/561] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:10 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:39:10.849200 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a1ecf909-ce73-467f-b8e1-9ca5418c07f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '.version_select at 0x7f2a7b79e3a0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:10.931794 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a1ecf909-ce73-467f-b8e1-9ca5418c07f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292922988" status: 204 len: 0 microversion: 2.20 time: 0.086189 Jun 16 00:39:10.932326 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 274/562] 10.222.0.20 () {60 vars in 1258 bytes} [Thu Jun 16 00:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292922988 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 00:39:11.073214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:11.074359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:11.080259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.080748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.081506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.082025 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.223170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:11.231385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d29e9674-13cb-458c-ac39-40f3bdfe1243 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1722 microversion: 2.1 time: 0.162038 Jun 16 00:39:11.231939 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 289/563] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:11 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:11.675972 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-89cae1ce-2101-4318-ae1d-9bb957656929 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: .version_select at 0x7f2a7b380940>, body: {"keypair": {"name": "tempest-keypair-1821654007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcYPPXYsTwKbD+KT8Km35YxbjulgLnua5aVB65aFWVWbxp7yG23B8XI3Z+q6mRZZbRo978eYHftnKMMgzcl71UWfQ/w99TfchqgRmyrI4zoQD2jDM5rIfc3ghU4Mgtq8Q=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:11.690062 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-89cae1ce-2101-4318-ae1d-9bb957656929 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for project 494ce289f1774df0833301de8e46ae11. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:11.694328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-89cae1ce-2101-4318-ae1d-9bb957656929 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for user 31973e5a04c14cfc90ab377eac5f4194 and project 494ce289f1774df0833301de8e46ae11. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:11.794208 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-89cae1ce-2101-4318-ae1d-9bb957656929 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.122069 Jun 16 00:39:11.794732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 275/564] 10.222.0.20 () {62 vars in 1199 bytes} [Thu Jun 16 00:39:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 00:39:11.824798 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:11.825356 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:11.831654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.832104 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.832925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:11.833359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:11.914241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lazy-loading 'services' on Instance uuid 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:12.078788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-56c945f2-be9c-4667-b846-d96d500c246f tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e/os-volume_attachments/b2bebf4b-af49-48bc-86a7-42bedc476aaa" status: 202 len: 0 microversion: 2.1 time: 0.258294 Jun 16 00:39:12.079384 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 290/565] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:39:11 2022] DELETE /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e/os-volume_attachments/b2bebf4b-af49-48bc-86a7-42bedc476aaa => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:39:12.249736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:12.250360 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:12.257117 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:12.258069 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:12.258406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:12.258840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:12.393658 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:12.402476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-69d48bae-8f53-4ffd-8acb-b07d28f61a24 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1722 microversion: 2.1 time: 0.156781 Jun 16 00:39:12.404234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 276/566] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:12 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:13.420841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:13.421535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:13.423479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=68 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:13.428728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:13.429187 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:13.429954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:13.430387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:13.581189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:13.589351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4fb93209-6290-4d11-a4d4-3840ed7c99e5 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1722 microversion: 2.1 time: 0.173762 Jun 16 00:39:13.589913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 291/567] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:13 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:13.823023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-456967153", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6844d01-625d-4b71-91cf-373fe3e3e7cc"}], "security_groups": [{"name": "tempest-securitygroup--483401710"}], "key_name": "tempest-keypair-1821654007", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:13.830005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:13.923696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] validate_networks() for [('a6844d01-625d-4b71-91cf-373fe3e3e7cc', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:39:14.242990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.243388 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.249448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.254976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.254976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.254976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.276096 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:14.304037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:39:14.304453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:39:14.305017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:39:14.305423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:39:14.305880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:39:14.315616 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.316060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.317138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.317569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.333758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for project 494ce289f1774df0833301de8e46ae11. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:14.337967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Getting quotas for user 31973e5a04c14cfc90ab377eac5f4194 and project 494ce289f1774df0833301de8e46ae11. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:14.349138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:39:14.352324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:39:14.462840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f753cb16-cbca-4dba-970f-3c8077b10ea9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.644048 Jun 16 00:39:14.463479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 277/568] 10.222.0.20 () {62 vars in 1187 bytes} [Thu Jun 16 00:39:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 00:39:14.473482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.474082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.528426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.536539 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.538072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.539168 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-00ffa515-2a8a-403a-b6ae-65290b110e1c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1281 microversion: 2.20 time: 0.069307 Jun 16 00:39:14.539706 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 278/569] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:14 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:39:14.570542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-37190fe7-c579-4577-aeff-4f27f069ee90 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 204 len: 0 microversion: 2.1 time: 0.331241 Jun 16 00:39:14.571115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 292/570] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:39:14 2022] DELETE /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:39:14.582933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.582933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.587210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.587686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.588459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.588922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.610279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.610279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.616936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.617436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.618309 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.618751 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.726815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.735630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-335ab818-3fd5-4909-aae9-ce29f73c95a3 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1515 microversion: 2.1 time: 0.160313 Jun 16 00:39:14.745011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 279/571] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:14 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:14.759257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:14.767843 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-aef7b1a4-3edb-4c3d-951f-4dd79c437efb tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1728 microversion: 2.1 time: 0.164231 Jun 16 00:39:14.768409 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 293/572] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:14 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:14.785178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:14.785178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:14.791244 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.791694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.792452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:14.792936 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:14.875705 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1a500bec-6bf9-477a-9e0f-0b203b8db88b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094801 Jun 16 00:39:14.876323 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 280/573] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:39:14 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:15.557600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:15.558312 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:15.565098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.565572 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.566333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.566771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.629429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:15.637872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:15.639497 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:15.640616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c320d702-9e23-47bd-b049-03932cdf13ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1285 microversion: 2.20 time: 0.086960 Jun 16 00:39:15.641380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 294/574] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:15 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:15.752154 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:15.752795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:15.759122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.759582 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.760351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.760814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.788262 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-643d1dcb-e745-4ab5-be8d-81feecadfd35 req-ac3406d8-59b1-46d7-9861-4b290528349a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:15.797727 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-643d1dcb-e745-4ab5-be8d-81feecadfd35 req-ac3406d8-59b1-46d7-9861-4b290528349a service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:15.798663 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-643d1dcb-e745-4ab5-be8d-81feecadfd35 req-ac3406d8-59b1-46d7-9861-4b290528349a service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:15.812869 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-643d1dcb-e745-4ab5-be8d-81feecadfd35 req-ac3406d8-59b1-46d7-9861-4b290528349a service nova] Creating event network-changed:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:39:15.818592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-643d1dcb-e745-4ab5-be8d-81feecadfd35 req-ac3406d8-59b1-46d7-9861-4b290528349a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035094 Jun 16 00:39:15.819540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 295/575] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:15.915056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:15.922783 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b469bba5-a3b6-4676-b82b-ba721562f9f8 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1515 microversion: 2.1 time: 0.174504 Jun 16 00:39:15.923347 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 281/576] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:15 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:16.660213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:16.661311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:16.668451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:16.668948 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:16.669946 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:16.670385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:16.760283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:16.770381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:16.771889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:16.773030 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-03db7c54-b23b-4845-b545-a354322ef8e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1277 microversion: 2.20 time: 0.117535 Jun 16 00:39:16.773583 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 296/577] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:16 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:16.939644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:16.940350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:16.947218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:16.949860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:16.949860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:16.949860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.132068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:17.142366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-035ba080-5227-42fa-921f-63fe4a1269c0 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1515 microversion: 2.1 time: 0.206148 Jun 16 00:39:17.143260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 282/578] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:16 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:17.791012 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:17.791615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:17.798618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:17.799063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.799824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:17.800260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.804269 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:17.845777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}, {"server_uuid": "2369b3bf-9cb7-44f5-87fc-ccb4290aee4e", "name": "network-vif-deleted", "tag": "a061b975-29ef-466b-868b-b3a82091bb69"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:17.854819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:17.856049 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:17.865320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:17.868714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] Creating event network-changed:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:39:17.869425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] Creating event network-vif-deleted:a061b975-29ef-466b-868b-b3a82091bb69 for instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e on hv-cinder-80382 Jun 16 00:39:17.872194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:17.873828 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:17.874935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-169fb28b-5422-4442-9e57-7cb89afd5e7e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1339 microversion: 2.20 time: 0.087759 Jun 16 00:39:17.875500 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 297/579] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:17 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:17.877113 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-519216ba-4873-46ea-b3c9-e7c4662877c7 req-6ec9549f-29e0-4699-ac44-a04b9a5c5352 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034903 Jun 16 00:39:17.877693 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 283/580] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:18.159281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:18.159904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:18.168571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.169273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.170219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.171026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.207334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.208413 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.208900 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lazy-loading 'fault' on Instance uuid 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:18.254905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6294a11cbb2a475da4864ca15b7959d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '213787a3040e45efb2c14f5dd9dcf509', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:18.262872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c4dee94d-3d4a-4c8f-a3ae-601703aa996b tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 200 len: 1309 microversion: 2.1 time: 0.107694 Jun 16 00:39:18.263447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 298/581] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:18 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:18.894474 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:18.895165 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:18.901228 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.901681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:18.902435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:18.902871 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.195418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:19.204002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:19.205641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:19.206741 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7b8be9ea-e1c0-4f10-9800-7ab84d71714e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.317016 Jun 16 00:39:19.207297 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 284/582] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:18 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:19.279245 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:19.279848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] [instance: 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:19.286934 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:19.290853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.290853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:19.290853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.302938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] HTTP exception thrown: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Request method failure captured: Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e HTTP/1.1 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnsbad2i9IuX8zSY38ALzTsTscTctpf69mPDNc6jEemSI-HGgPUl8UPKDjxa5Xl8itbCrGXLMKI8ZiBiIWXZnR3ML4SACjnCQge9r6xc47BS_7gxCFpOrEPFPNGiUFAqxdc4kd_zwduNrVhcCkOOwDjIon3EIKdHO1yXR2juLeC_XVA Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 213787a3040e45efb2c14f5dd9dcf509 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:39:19.304761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/213787a3040e45efb2c14f5dd9dcf509"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/213787a3040e45efb2c14f5dd9dcf509"}]}] Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 213787a3040e45efb2c14f5dd9dcf509 Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-534948220 Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesSnapshotTestJSON-534948220-project Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 6294a11cbb2a475da4864ca15b7959d5 Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesSnapshotTestJSON-534948220-project Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. Jun 16 00:39:19.306330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '2369b3bf-9cb7-44f5-87fc-ccb4290aee4e'} Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:19.307102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. Jun 16 00:39:19.309170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:19.310338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] Returning 404 to user: Instance 2369b3bf-9cb7-44f5-87fc-ccb4290aee4e could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:19.310338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-388d6bde-0768-4f8c-bf3f-97c7c7a53592 tempest-VolumesSnapshotTestJSON-534948220 tempest-VolumesSnapshotTestJSON-534948220-project] 10.222.0.20 "GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e" status: 404 len: 111 microversion: 2.1 time: 0.030789 Jun 16 00:39:19.310338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 299/583] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:19 2022] GET /compute/v2.1/servers/2369b3bf-9cb7-44f5-87fc-ccb4290aee4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:19.898522 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-98940aee-857d-4a10-8719-b96327f5d79d req-e7ead9dc-3626-4f71-9320-8552a9bcfb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:19.908060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-98940aee-857d-4a10-8719-b96327f5d79d req-e7ead9dc-3626-4f71-9320-8552a9bcfb5f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:19.911187 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-98940aee-857d-4a10-8719-b96327f5d79d req-e7ead9dc-3626-4f71-9320-8552a9bcfb5f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:19.922027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-98940aee-857d-4a10-8719-b96327f5d79d req-e7ead9dc-3626-4f71-9320-8552a9bcfb5f service nova] Creating event network-changed:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:39:19.926762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-98940aee-857d-4a10-8719-b96327f5d79d req-e7ead9dc-3626-4f71-9320-8552a9bcfb5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031906 Jun 16 00:39:19.927671 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 285/584] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:20.224507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:20.225109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:20.231592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.232037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.232827 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:20.233255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:20.363139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:20.371589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:20.373126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:20.374225 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-492d0e0c-a2bc-44dd-a5e0-8f8ecb25b984 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.153850 Jun 16 00:39:20.374771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 300/585] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:20 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:21.393475 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:21.394162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:21.400504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:21.400986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.401744 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:21.402181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:21.614962 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:21.623361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:21.624876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:21.625999 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-81bae1da-a142-4e09-befa-d3fcdd5f443e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.237573 Jun 16 00:39:21.626551 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 286/586] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:21 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:22.643743 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:22.644351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:22.650910 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.651363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:22.652159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:22.652621 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:22.784067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:22.791903 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:22.793440 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:22.794541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0a77c379-a3e4-4d6d-bdd1-556df0285f42 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.154683 Jun 16 00:39:22.795085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 301/587] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:22 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:23.813065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:23.816007 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:23.820475 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:23.820961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.821718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:23.822162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:23.950463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:23.958423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:23.959928 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:23.961057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d2136169-2762-489c-a854-b6fda2807ac2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.152504 Jun 16 00:39:23.961615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 287/588] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:23 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:24.044191 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:24.044770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:24.051138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.051589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.052345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.052813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.075960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-21f1dc0a-ec28-4b74-a0a9-a88923483713 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/ips" status: 200 len: 150 microversion: 2.1 time: 0.035606 Jun 16 00:39:24.076441 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 302/589] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:39:24 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:24.979422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:24.980141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:24.982126 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:24.982802 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=12 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:24.988352 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.989263 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:24.989681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:24.990146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:25.120130 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:25.128991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:25.130417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:25.131505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4258c82f-e7b6-43d7-bcbf-41e2ee444a2c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.156221 Jun 16 00:39:25.132062 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 288/590] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:24 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:25.693100 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60a70575-af89-4373-b0d1-1713c4ac2e13"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:25.694195 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:25.701442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:25.714611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:25.714611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:25.714611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:26.150380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:26.151187 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:26.157506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:26.157957 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:26.158721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:26.159156 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:26.296170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:26.304219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:26.306082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:26.307162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6115d6df-574f-4e3d-ac99-dabe9dc1dbd7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.161429 Jun 16 00:39:26.307709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 289/591] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:26 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:39:26.386430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e7d3b9a0-d0f7-40f1-ab8e-c5c95a6f5d57 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697384 Jun 16 00:39:26.387048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 303/592] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:39:25 2022] POST /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:26.464919 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-56703672-65ab-424c-920d-b261ebebf24a req-650171eb-577f-4478-a3ba-fae5245e870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "name": "network-vif-plugged", "status": "completed", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:26.473933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-56703672-65ab-424c-920d-b261ebebf24a req-650171eb-577f-4478-a3ba-fae5245e870b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:26.474379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-56703672-65ab-424c-920d-b261ebebf24a req-650171eb-577f-4478-a3ba-fae5245e870b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:26.486127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-56703672-65ab-424c-920d-b261ebebf24a req-650171eb-577f-4478-a3ba-fae5245e870b service nova] Creating event network-vif-plugged:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:39:26.491107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-56703672-65ab-424c-920d-b261ebebf24a req-650171eb-577f-4478-a3ba-fae5245e870b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029749 Jun 16 00:39:26.491834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 290/593] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:27.326655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:27.327355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:27.334033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:27.334486 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:27.335248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:27.335711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:27.470568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:27.478550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:27.480156 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:27.482004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3f333652-dd2b-4a4c-9ae0-fc0a97f5549e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.160686 Jun 16 00:39:27.482606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 304/594] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:27 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:28.501663 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:28.502494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:28.509453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:28.509830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:28.510731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:28.511410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:28.642921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:28.645251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:28.651505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:28.653700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:28.654777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c821bc8e-020e-47a9-a668-4568605402f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1406 microversion: 2.20 time: 0.159252 Jun 16 00:39:28.655321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 291/595] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:28 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:29.671995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:29.672625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:29.679106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.682603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.682603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.682603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.808358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:29.816796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:29.818540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:29.819665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cfd950f8-9381-4501-bed2-fe0e94a2a61e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1598 microversion: 2.20 time: 0.151645 Jun 16 00:39:29.820213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 305/596] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:39:29 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:39:29.837034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:29.837545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:29.843882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.844332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.845104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:29.845536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:29.923223 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e06d1150-b3aa-4428-89ab-19ddd2da01f7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090346 Jun 16 00:39:29.923808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 292/597] 10.222.0.20 () {60 vars in 1315 bytes} [Thu Jun 16 00:39:29 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:39:30.866027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-671c4bcc-ac13-4e47-a20f-6f55b868ad4e req-92055065-24ba-4b51-b98d-b11a8bf97837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:30.875247 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-671c4bcc-ac13-4e47-a20f-6f55b868ad4e req-92055065-24ba-4b51-b98d-b11a8bf97837 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:30.875695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-671c4bcc-ac13-4e47-a20f-6f55b868ad4e req-92055065-24ba-4b51-b98d-b11a8bf97837 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:30.886695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-671c4bcc-ac13-4e47-a20f-6f55b868ad4e req-92055065-24ba-4b51-b98d-b11a8bf97837 service nova] Creating event network-changed:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:39:30.892190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-671c4bcc-ac13-4e47-a20f-6f55b868ad4e req-92055065-24ba-4b51-b98d-b11a8bf97837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029825 Jun 16 00:39:30.893093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 306/598] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:34.932175 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60a70575-af89-4373-b0d1-1713c4ac2e13"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:34.933234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:34.939732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:34.944151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:34.944151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:34.944151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.207114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: POST /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments HTTP/1.1 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 74 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:39:35.208860 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {"volumeAttachment": {"volumeId": "60a70575-af89-4373-b0d1-1713c4ac2e13"}} Jun 16 00:39:35.210322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'server_id': 'c9783fec-706a-4ed8-96b9-b5d790347dc8', 'body': {'volumeAttachment': {'volumeId': '60a70575-af89-4373-b0d1-1713c4ac2e13'}}} Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:35.211651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:35.213147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 400 to user: Invalid volume: volume 60a70575-af89-4373-b0d1-1713c4ac2e13 is already attached to instances: c9783fec-706a-4ed8-96b9-b5d790347dc8 {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-51818345-58dc-4dd7-b155-c841474bd3f3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.282827 Jun 16 00:39:35.215818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 293/599] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:39:34 2022] POST /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments => generated 174 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:39:35.272956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:35.273533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:35.280002 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:35.280459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.281266 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:35.281705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.417321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'services' on Instance uuid c9783fec-706a-4ed8-96b9-b5d790347dc8 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:35.574667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-70878ca1-97e4-4df9-affb-1e144df9e9b4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments/60a70575-af89-4373-b0d1-1713c4ac2e13" status: 202 len: 0 microversion: 2.1 time: 0.306375 Jun 16 00:39:35.575253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 307/600] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:39:35 2022] DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments/60a70575-af89-4373-b0d1-1713c4ac2e13 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:39:35.585820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:35.586829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:35.594433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:35.595115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.596064 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:35.596498 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:35.625410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2da87e1c-8ae9-48f0-82b5-8f497cb9980f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Jun 16 00:39:35.625993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 294/601] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:35 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:36.638700 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:36.639767 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:36.646649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:36.647101 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:36.647873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:36.648310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:36.682844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ef2c6ce2-bcd1-4044-a764-d3d772be530b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Jun 16 00:39:36.683327 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 308/602] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:36 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:37.695074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:37.695998 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:37.702454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.702907 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.703665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.704325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.732764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4ec5f2f1-4e65-458f-b178-2f600df55279 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041746 Jun 16 00:39:37.733262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 295/603] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:37 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:39:37.794293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:37.794780 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:37.801271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.801722 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.802489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:37.802922 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:37.827086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:38.067023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d3a5bbb8-fa4b-42d6-a1ad-b4db41a3f288 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 204 len: 0 microversion: 2.1 time: 0.276788 Jun 16 00:39:38.067853 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 309/604] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:39:37 2022] DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:39:38.076109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:38.076816 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:38.082797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.083256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.084018 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:38.084457 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:38.212772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:38.220111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d070061f-4ec6-42e0-a245-b2494e0aaba0 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1682 microversion: 2.1 time: 0.147929 Jun 16 00:39:38.220686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 296/605] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:38 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:39.237836 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:39.238451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:39.244834 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:39.248155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:39.248155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:39.248155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:39.383528 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:39.391712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5fa846ed-fb71-4347-bac2-b15f04fcace6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1682 microversion: 2.1 time: 0.158185 Jun 16 00:39:39.392269 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 310/606] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:39 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:40.410485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:40.411269 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:40.418117 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:40.418562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:40.419323 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:40.419786 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:40.586717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:40.595171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6202166d-035c-4299-b4c5-8def9ca6cb99 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1682 microversion: 2.1 time: 0.189083 Jun 16 00:39:40.597906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 297/607] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:40 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:40.833730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-f5d3632a-a715-4f62-ba81-46e65a5ba18f req-09f426d9-571b-40e9-9999-5b988ba2c64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9783fec-706a-4ed8-96b9-b5d790347dc8", "name": "network-vif-deleted", "tag": "d19ee40c-ad48-4dc4-be4e-bfe79a861aa1"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:40.842184 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-f5d3632a-a715-4f62-ba81-46e65a5ba18f req-09f426d9-571b-40e9-9999-5b988ba2c64f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:40.842632 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-f5d3632a-a715-4f62-ba81-46e65a5ba18f req-09f426d9-571b-40e9-9999-5b988ba2c64f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:40.853366 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-f5d3632a-a715-4f62-ba81-46e65a5ba18f req-09f426d9-571b-40e9-9999-5b988ba2c64f service nova] Creating event network-vif-deleted:d19ee40c-ad48-4dc4-be4e-bfe79a861aa1 for instance c9783fec-706a-4ed8-96b9-b5d790347dc8 on hv-cinder-80382 Jun 16 00:39:40.858111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-f5d3632a-a715-4f62-ba81-46e65a5ba18f req-09f426d9-571b-40e9-9999-5b988ba2c64f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028099 Jun 16 00:39:40.859051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 311/608] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:41.614565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:41.615170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:41.621754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:41.622211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:41.623032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:41.623465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:41.657692 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:41.658182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:41.658639 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'fault' on Instance uuid c9783fec-706a-4ed8-96b9-b5d790347dc8 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:41.709955 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:41.719250 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-985c2ef8-b2d3-490a-ba8e-25410cd0c48e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 200 len: 1331 microversion: 2.1 time: 0.108665 Jun 16 00:39:41.720039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 298/609] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:41 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:42.737765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:42.738375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:42.744771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:42.745213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:42.745969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:42.746398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:42.748975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:42.761909 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 HTTP/1.1 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:39:42.762744 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:39:42.764854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'c9783fec-706a-4ed8-96b9-b5d790347dc8'} Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:39:42.768736 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:39:42.770371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:39:42.771737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:39:42.771737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-05d7521a-1a54-4655-8855-a9bc6e632a54 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 404 len: 111 microversion: 2.1 time: 0.031707 Jun 16 00:39:42.771737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 312/610] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:42 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:42.774612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-eaba9510-b79b-425e-9518-b6d53573a8c1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '.version_select at 0x7f2a7b3c3c10>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:42.897626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-eaba9510-b79b-425e-9518-b6d53573a8c1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-730056253" status: 202 len: 0 microversion: 2.1 time: 0.127798 Jun 16 00:39:42.898421 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 299/611] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:39:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-730056253 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:39:43.623851 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cd41bd5b-9c2b-42c6-bf44-ce4d61afeb56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: .version_select at 0x7f2a7b3b2f70>, body: {"keypair": {"name": "tempest-keypair-1173656705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSwZiVxIdN3/87B2HAJLb9G4LjmlBv/ac5w16qsOawGYE4OM1mUG+KoTG1ndgHgrNOVBl+YAx+i8saxztzpobnv/M2y8hTAfQLyroCNp3IZAkNzePKonXogK+eMRd0jdg=="}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:43.628044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:43.638756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-cd41bd5b-9c2b-42c6-bf44-ce4d61afeb56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:43.642488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-cd41bd5b-9c2b-42c6-bf44-ce4d61afeb56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:43.742523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cd41bd5b-9c2b-42c6-bf44-ce4d61afeb56 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122454 Jun 16 00:39:43.743169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 313/612] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:39:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:45.862710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1316229150", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffe9c59a-3096-4aef-8b2e-e3aa63722c28"}], "security_groups": [{"name": "tempest-securitygroup--441098413"}], "key_name": "tempest-keypair-1173656705", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:45.873505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:45.970956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] validate_networks() for [('ffe9c59a-3096-4aef-8b2e-e3aa63722c28', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:39:46.361127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:39:46.361827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:39:46.363990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:39:46.363990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:39:46.363990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:39:46.375784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:46.376243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:46.377090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:46.377539 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:46.395122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:39:46.399270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Getting quotas for user 052ae1db33014bb5915dc228f1b76d5c and project 45031128a55e42989da61e01948538d3. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:39:46.410305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:39:46.412585 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:39:46.566834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-704ad3b6-0cb4-4203-aa3b-9f3cfb3ff82d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.710328 Jun 16 00:39:46.568081 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 300/613] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:39:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:39:46.786379 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f1902752-0d14-4ee0-bab4-249aca3c0677 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:46.786991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f1902752-0d14-4ee0-bab4-249aca3c0677 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:46.840322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f1902752-0d14-4ee0-bab4-249aca3c0677 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:46.847894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f1902752-0d14-4ee0-bab4-249aca3c0677 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1242 microversion: 2.1 time: 0.273860 Jun 16 00:39:46.848456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 314/614] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:46 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1242 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:47.865909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:47.866561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:47.874057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:47.874510 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:47.875290 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:47.875734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:47.940135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:47.947883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f5eea80c-2e2a-404d-bdc9-e84a4b62a191 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1238 microversion: 2.1 time: 0.086360 Jun 16 00:39:47.948443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 301/615] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:47 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:48.964967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:48.965677 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:48.972390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:48.972876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:48.973685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:48.974109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:49.035652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:49.043494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a021867d-847a-456c-ae37-91a9b9d240ab tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1312 microversion: 2.1 time: 0.082030 Jun 16 00:39:49.043757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 315/616] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:48 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:50.072055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:50.072859 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:50.079824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:50.080737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:50.081723 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:50.082110 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:50.288117 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:50.296787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ae83ae98-05e4-4cdd-967e-dfe62f2bf745 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.240537 Jun 16 00:39:50.297461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 302/617] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:50 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:50.403726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-6250ba73-9c6c-4212-80ce-642c06413a94 req-758b6518-f177-4fcf-ab68-e2b887c033f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f013d4-e901-45ae-9bce-c0d5f28dfd77", "tag": "cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:50.413380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-6250ba73-9c6c-4212-80ce-642c06413a94 req-758b6518-f177-4fcf-ab68-e2b887c033f9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:50.413728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-6250ba73-9c6c-4212-80ce-642c06413a94 req-758b6518-f177-4fcf-ab68-e2b887c033f9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:50.428349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-6250ba73-9c6c-4212-80ce-642c06413a94 req-758b6518-f177-4fcf-ab68-e2b887c033f9 service nova] Creating event network-changed:cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698 for instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 on hv-cinder-80382 Jun 16 00:39:50.434071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-6250ba73-9c6c-4212-80ce-642c06413a94 req-758b6518-f177-4fcf-ab68-e2b887c033f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034573 Jun 16 00:39:50.434765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 316/618] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:51.314464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:51.315101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:51.322002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:51.322444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:51.323199 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:51.323690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:51.454893 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:51.462365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fead4776-b41a-4bba-9045-45726ae1d65e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.152247 Jun 16 00:39:51.462913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 303/619] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:51 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:52.480164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:52.481039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:52.487861 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:52.488306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:52.489082 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:52.489513 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:52.615712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:52.623152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-421fe57c-a26e-45f6-92b5-6dd309331c7c tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.147597 Jun 16 00:39:52.623712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 317/620] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:52 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:53.518798 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:53.519301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:53.525773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.526221 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.526979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.527408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.615153 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'services' on Instance uuid 4b06a62e-3a82-4a98-b470-cdc82179df7b {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:39:53.640381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:53.641153 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:53.648123 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.653424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.653424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.653424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.780750 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:53.788245 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-10c23124-b575-427f-9873-15e59eb92080 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.152842 Jun 16 00:39:53.788829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 318/621] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:53 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:39:53.821448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-541f26ca-ab7e-40c2-9db7-a09cbfc431fc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments/de76d558-dff2-45c5-862e-852bf4ef0d9e" status: 202 len: 0 microversion: 2.1 time: 0.306357 Jun 16 00:39:53.822025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 304/622] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:39:53 2022] DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments/de76d558-dff2-45c5-862e-852bf4ef0d9e => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:39:53.830626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:53.831552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:53.837582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.838040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.838807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:53.839248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:53.867716 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-90aad990-266d-4c27-801f-e4542d415eb8 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Jun 16 00:39:53.868272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 319/623] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:53 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:54.805933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:54.806624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:54.814307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:54.814753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:54.815686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:54.816120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:54.880295 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:54.881253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:54.887720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:54.888170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:54.889520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:54.889951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:54.919215 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6868860e-7485-4b87-bede-72743bdc5468 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Jun 16 00:39:54.919769 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 320/624] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:54 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:54.953034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:54.961294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-89f79164-c317-4a2f-81c4-60f7d6510e52 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.160254 Jun 16 00:39:54.961857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 305/625] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:54 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:55.977987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:55.978607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:55.985458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:55.985909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:55.986669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:55.987205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:56.093661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:56.094586 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:56.100509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:56.100990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:56.101754 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:56.102194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:56.114804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:56.122136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-29b39058-6e94-4ebd-b494-77f4a0bbb210 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.148214 Jun 16 00:39:56.122699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 306/626] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:55 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:39:56.131742 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-eac43260-3ee6-489b-bcb2-81678749b1da tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203654 Jun 16 00:39:56.132356 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 321/627] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:55 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:57.138304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:57.138917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:57.140931 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:57.141629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=6 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:57.143073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:57.143991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:57.146045 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:57.147076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:57.147526 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:57.148292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:57.148759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:57.151260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:57.151715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:57.152477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:57.152940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:57.182707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d5eae8ec-5aef-442c-b26e-5931c32cb459 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Jun 16 00:39:57.183276 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 322/628] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:57 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:39:57.281211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:57.288597 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-67b65238-2fbc-4e34-bbe9-5d31bfc58447 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.154113 Jun 16 00:39:57.289151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 307/629] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:57 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:58.195113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:58.196073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:58.202646 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:58.203097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:58.203882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:58.204320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:58.232362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b9ca0657-1060-4837-bb25-3d7bac5304e9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 Jun 16 00:39:58.232940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 323/630] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:58 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:58.306235 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:58.306836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:58.315709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:58.316229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:58.317037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:58.317477 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:58.455998 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:58.463551 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-41817842-a63a-4b91-84e7-995f5df49981 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.161506 Jun 16 00:39:58.464116 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 308/631] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:58 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:39:59.128724 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-9de38512-660e-49b5-8a8a-96270f7a6e5a req-eea70314-957a-4502-bf5a-72d03bb1ffba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f013d4-e901-45ae-9bce-c0d5f28dfd77", "name": "network-vif-plugged", "status": "completed", "tag": "cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:39:59.136782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-9de38512-660e-49b5-8a8a-96270f7a6e5a req-eea70314-957a-4502-bf5a-72d03bb1ffba service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.137227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-9de38512-660e-49b5-8a8a-96270f7a6e5a req-eea70314-957a-4502-bf5a-72d03bb1ffba service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.148344 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-9de38512-660e-49b5-8a8a-96270f7a6e5a req-eea70314-957a-4502-bf5a-72d03bb1ffba service nova] Creating event network-vif-plugged:cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698 for instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 on hv-cinder-80382 Jun 16 00:39:59.152986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-9de38512-660e-49b5-8a8a-96270f7a6e5a req-eea70314-957a-4502-bf5a-72d03bb1ffba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028009 Jun 16 00:39:59.153557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 324/632] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:39:59.244411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:59.245444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:59.251425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.251877 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.252681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.253116 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.278644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:59.294256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c008f8b4-cbee-43bc-9fd0-6a6a6c75a892 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053853 Jun 16 00:39:59.294852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 309/633] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:39:59 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:39:59.383024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:59.383631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:59.389835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.390933 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.391698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.392135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.417745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:39:59.480599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:59.481213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:59.488336 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.488819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.489587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.490024 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.621557 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:59.629370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c8a8dda3-3bef-4890-afe4-5fef39e775c3 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.152981 Jun 16 00:39:59.629926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 310/634] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:59 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:39:59.656094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-21a2f94f-95d8-4364-a55a-4b9df4995adc tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 204 len: 0 microversion: 2.1 time: 0.276861 Jun 16 00:39:59.656708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 325/635] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:39:59 2022] DELETE /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:39:59.664444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:39:59.665132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:39:59.671090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.672050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.672886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:39:59.673251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:39:59.805727 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:39:59.813873 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bd818d29-c071-4d22-8400-db94217e7772 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.153213 Jun 16 00:39:59.814427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 311/636] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:39:59 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:00.647132 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:00.647835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:00.654417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:00.654866 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:00.655621 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:00.656982 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:00.783317 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:00.790713 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3f42420a-9e25-41d8-87fa-b82d81932fee tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.147793 Jun 16 00:40:00.791263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 326/637] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:00 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:00.831573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:00.832897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:00.840028 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:00.840477 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:00.841262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:00.841691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:00.969611 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:00.976923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bf297444-3956-4637-9270-95a605892e41 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.149756 Jun 16 00:40:00.977472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 312/638] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:00 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:01.806497 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:01.807095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:01.813618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:01.814062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:01.814812 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:01.815244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:01.946190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:01.954041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-27e1810a-f54a-4e91-8e5d-78bc241c9450 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.151429 Jun 16 00:40:01.954600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 327/639] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:01 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:01.993535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:01.994136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:02.000603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:02.001059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:02.001816 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:02.002259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:02.132694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:02.140638 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b99793ce-0789-4782-8a08-326bf1104748 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.150418 Jun 16 00:40:02.141199 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 313/640] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:01 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:02.970652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:02.971274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:02.978895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:02.978895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:02.979154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:02.979591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:03.113240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:03.120589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4ab85775-fa58-49a9-99bb-d3bf594b093f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.153974 Jun 16 00:40:03.121143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 328/641] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:02 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:03.157632 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:03.158162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:03.164434 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:03.164974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:03.165761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:03.166071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:03.315373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:03.326218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a29b22ec-0244-4fd4-aaac-ee346473da7b tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.172910 Jun 16 00:40:03.326791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 314/642] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:03 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:04.137711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:04.138349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:04.145629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:04.146081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:04.146846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:04.147282 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:04.273185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:04.280546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c1cd939d-b391-4673-8c08-1e546e163ed1 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.146667 Jun 16 00:40:04.281104 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 329/643] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:04 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:04.342673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:04.343278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:04.349636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:04.350083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:04.350829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:04.351261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:04.476946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:04.484878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ad4f58e5-e162-46d8-8f1d-ca531bd0b26e tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.145523 Jun 16 00:40:04.485425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 315/644] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:04 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:05.297542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:05.298195 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:05.305272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:05.305717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:05.306477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:05.306911 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:05.438366 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:05.445995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-37c17f38-d0a1-46b1-9b58-8a5989fe7878 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.152675 Jun 16 00:40:05.447347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 330/645] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:05 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:05.502113 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:05.502715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:05.509101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:05.509549 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:05.510300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:05.510730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:05.635419 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:05.643387 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9a144add-4e37-4dd9-9a89-2e2b31a07d0d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1688 microversion: 2.1 time: 0.145684 Jun 16 00:40:05.643940 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 316/646] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:05 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:06.462933 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:06.463471 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:06.470653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:06.471051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:06.471819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:06.472256 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:06.474949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:06.609375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:06.618390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8b2385e8-e74c-4538-8c85-94d69ddad3ea tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1367 microversion: 2.1 time: 0.159431 Jun 16 00:40:06.618960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 331/647] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:06 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:06.663029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:06.664304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:06.678584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:06.679041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:06.679821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:06.680259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:06.801190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:06.808748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8d820e44-a9f3-4d5a-a820-43c84e3a9754 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1620 microversion: 2.1 time: 0.152393 Jun 16 00:40:06.809314 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 317/648] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:06 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1620 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:06.886451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-e75f9f41-19c5-4235-91ef-9b5232b36220 req-33768c61-be89-41a5-9f58-0b2cbd860e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b06a62e-3a82-4a98-b470-cdc82179df7b", "name": "network-vif-deleted", "tag": "4557ec90-6594-4691-a0bc-66834fbe9117"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:06.895280 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-e75f9f41-19c5-4235-91ef-9b5232b36220 req-33768c61-be89-41a5-9f58-0b2cbd860e89 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:06.895748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-e75f9f41-19c5-4235-91ef-9b5232b36220 req-33768c61-be89-41a5-9f58-0b2cbd860e89 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:06.907128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-e75f9f41-19c5-4235-91ef-9b5232b36220 req-33768c61-be89-41a5-9f58-0b2cbd860e89 service nova] Creating event network-vif-deleted:4557ec90-6594-4691-a0bc-66834fbe9117 for instance 4b06a62e-3a82-4a98-b470-cdc82179df7b on hv-cinder-80382 Jun 16 00:40:06.911913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-e75f9f41-19c5-4235-91ef-9b5232b36220 req-33768c61-be89-41a5-9f58-0b2cbd860e89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029076 Jun 16 00:40:06.912495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 332/649] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:07.635237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:07.636165 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:07.643642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.644094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.645036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.645378 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.784541 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:07.792623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6945d977-a2cb-4840-8872-3a0562684bfd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1557 microversion: 2.1 time: 0.161094 Jun 16 00:40:07.793219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 318/650] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:07 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:07.811541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:07.812289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:07.820550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.821180 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.821913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.822355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.826850 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:07.827756 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:07.833827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.834286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.835067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.835504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.870955 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:07.871464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:07.871926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'fault' on Instance uuid 4b06a62e-3a82-4a98-b470-cdc82179df7b {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:40:07.927508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:07.936618 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b3c2e7fa-8482-43f2-92bc-6391da450237 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 200 len: 1334 microversion: 2.1 time: 0.113569 Jun 16 00:40:07.937656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 319/651] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:07 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:07.944485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-07aae8e1-2b2a-479f-b17e-c1e5f706d9a4 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138186 Jun 16 00:40:07.945350 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 333/652] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:40:07 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:08.953699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:08.954305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 4b06a62e-3a82-4a98-b470-cdc82179df7b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:08.960833 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:08.961285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:08.962044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:08.962485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:08.975892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] HTTP exception thrown: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Request method failure captured: Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b HTTP/1.1 Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqut7v3ybWuAnrqMcwjd_4c8R3L_IH68MNR5jafHKKTh49sm50FoSRXqCiOJobjLW9BpA0h-S7ruzCdwqpL0kg0NFc04RbG98gNfkfCDCcFZL5PdzyZLcWBQRXTM5kWwv4_cCdovYl8vuA3s9obwbYWEaTzMAWMbiX5JyZOrCAOw8g Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:40:08.977548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}] Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: c9dcfb252f0d44a280b3448094883e13 Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. Jun 16 00:40:08.981878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '4b06a62e-3a82-4a98-b470-cdc82179df7b'} Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:08.982922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. Jun 16 00:40:08.984791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:08.986082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Returning 404 to user: Instance 4b06a62e-3a82-4a98-b470-cdc82179df7b could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:08.986082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5399fc6a-bdb1-4d3c-9b53-b5e0e1e5bc25 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b" status: 404 len: 111 microversion: 2.1 time: 0.029115 Jun 16 00:40:08.986082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 320/653] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:08 2022] GET /compute/v2.1/servers/4b06a62e-3a82-4a98-b470-cdc82179df7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:08.988702 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a67fd692-616c-4e66-8c22-2830efcce693 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '.version_select at 0x7f2a7b2cfe50>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:09.080012 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a67fd692-616c-4e66-8c22-2830efcce693 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886926461" status: 202 len: 0 microversion: 2.1 time: 0.095795 Jun 16 00:40:09.080631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 334/654] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:40:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886926461 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:40:09.572669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-27d45d18-1f69-4a8e-acc9-6c4af4243c9e req-37997cf5-8afc-4063-acb3-b8d5867161e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f013d4-e901-45ae-9bce-c0d5f28dfd77", "tag": "cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:09.582415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-27d45d18-1f69-4a8e-acc9-6c4af4243c9e req-37997cf5-8afc-4063-acb3-b8d5867161e3 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:09.582868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-27d45d18-1f69-4a8e-acc9-6c4af4243c9e req-37997cf5-8afc-4063-acb3-b8d5867161e3 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:09.603141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-27d45d18-1f69-4a8e-acc9-6c4af4243c9e req-37997cf5-8afc-4063-acb3-b8d5867161e3 service nova] Creating event network-changed:cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698 for instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 on hv-cinder-80382 Jun 16 00:40:09.608376 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-27d45d18-1f69-4a8e-acc9-6c4af4243c9e req-37997cf5-8afc-4063-acb3-b8d5867161e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188411 Jun 16 00:40:09.609554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 321/655] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:12.524108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:12.525625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:12.534354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.534798 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.535782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.536598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.565506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:40:12.845186 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f38067ee-df62-4cb3-8c94-0065e32b9493 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 204 len: 0 microversion: 2.1 time: 0.325453 Jun 16 00:40:12.847240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 335/656] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:40:12 2022] DELETE /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:40:12.856366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:12.857126 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:12.863782 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.864503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:12.865775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:12.866215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:13.290353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:13.298101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-78d2de4a-0883-4088-abaf-8ded962c6287 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1508 microversion: 2.1 time: 0.446443 Jun 16 00:40:13.298659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 322/657] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:12 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:14.317515 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:14.319847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:14.331821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.332686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.333710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.334362 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.470891 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:14.472189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:14.479626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.480314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.481278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:14.481873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:14.511082 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-91070f4d-01b4-459f-94c5-4e9fe19bae74 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/ips" status: 200 len: 152 microversion: 2.20 time: 0.229639 Jun 16 00:40:14.511755 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 336/658] 10.222.0.20 () {60 vars in 1288 bytes} [Thu Jun 16 00:40:14 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/ips => generated 152 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:40:14.557708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:14.567715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2c730d06-63d8-4487-8a50-3d1d32919418 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1508 microversion: 2.1 time: 0.256044 Jun 16 00:40:14.569951 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 323/659] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:14 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:15.589419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:15.590111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:15.605172 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:15.605629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:15.606494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:15.606821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:15.803545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:15.810680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8c6a5b40-8208-4f51-bee8-dc07dd434a5f tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1508 microversion: 2.1 time: 0.227972 Jun 16 00:40:15.821880 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 337/660] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:15 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:16.256853 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-dec08a73-d8b6-41cc-97ba-9e671ebb77ca req-c39bea6e-7f0c-471f-a87b-07c572c5265e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76508475-0af3-48d7-8f12-9ad3686d77f0", "name": "network-vif-deleted", "tag": "ba7aa17f-4993-4f62-8ae9-acb5a856dcd4"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:16.260472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:16.272007 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-dec08a73-d8b6-41cc-97ba-9e671ebb77ca req-c39bea6e-7f0c-471f-a87b-07c572c5265e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.272736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-dec08a73-d8b6-41cc-97ba-9e671ebb77ca req-c39bea6e-7f0c-471f-a87b-07c572c5265e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.291811 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-dec08a73-d8b6-41cc-97ba-9e671ebb77ca req-c39bea6e-7f0c-471f-a87b-07c572c5265e service nova] Creating event network-vif-deleted:ba7aa17f-4993-4f62-8ae9-acb5a856dcd4 for instance 76508475-0af3-48d7-8f12-9ad3686d77f0 on hv-cinder-80382 Jun 16 00:40:16.305807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-dec08a73-d8b6-41cc-97ba-9e671ebb77ca req-c39bea6e-7f0c-471f-a87b-07c572c5265e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152396 Jun 16 00:40:16.311049 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 324/661] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:16.655728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:16.656842 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:16.659205 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:16.664031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.664411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.665211 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.665647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.688959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lazy-loading 'flavor' on Instance uuid 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:40:16.830877 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:16.830877 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:16.838868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.839323 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.840100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.840555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.874261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:16.875342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:16.875879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'fault' on Instance uuid 76508475-0af3-48d7-8f12-9ad3686d77f0 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:40:16.924111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:16.932145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-079eca1f-4fc2-49c2-bb0e-562f06962a43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 200 len: 1312 microversion: 2.1 time: 0.107736 Jun 16 00:40:16.932814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 325/662] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:16 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:17.230606 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-155dbe22-1b23-437d-83b7-fd77ee44932e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/action" status: 202 len: 0 microversion: 2.20 time: 0.578418 Jun 16 00:40:17.234712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 338/663] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jun 16 00:40:16 2022] POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:40:17.240022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:17.240769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:17.248669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.248669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.249128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.249602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.425038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:17.438963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:17.440725 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:17.442482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-db6153ac-1af4-4cc9-a20b-34bd638855ad tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.206091 Jun 16 00:40:17.449717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 326/664] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:17 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:17.956955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:17.957798 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: 76508475-0af3-48d7-8f12-9ad3686d77f0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:17.964970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.965481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.966321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:17.966753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:17.983299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] HTTP exception thrown: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Request method failure captured: Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 HTTP/1.1 Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqut7v3ybWuAnrqMcwjd_4c8R3L_IH68MNR5jafHKKTh49sm50FoSRXqCiOJobjLW9BpA0h-S7ruzCdwqpL0kg0NFc04RbG98gNfkfCDCcFZL5PdzyZLcWBQRXTM5kWwv4_cCdovYl8vuA3s9obwbYWEaTzMAWMbiX5JyZOrCAOw8g Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:40:17.985421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}] Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: c9dcfb252f0d44a280b3448094883e13 Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. Jun 16 00:40:17.987139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '76508475-0af3-48d7-8f12-9ad3686d77f0'} Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:17.988041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. Jun 16 00:40:17.989533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:40:17.990964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Returning 404 to user: Instance 76508475-0af3-48d7-8f12-9ad3686d77f0 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:17.990964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c48795d8-7591-4468-ae93-c7dd48969ea9 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0" status: 404 len: 111 microversion: 2.1 time: 0.035027 Jun 16 00:40:17.990964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 339/665] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:17 2022] GET /compute/v2.1/servers/76508475-0af3-48d7-8f12-9ad3686d77f0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:17.999172 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:18.001949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:18.010707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.011167 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.012019 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.012460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.034931 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:18.048917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:40:18.320858 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-94af690f-e965-4771-a3e0-08f27d262d9d tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 204 len: 0 microversion: 2.1 time: 0.327331 Jun 16 00:40:18.326989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 327/666] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:40:17 2022] DELETE /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:40:18.330155 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:18.330756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:18.342509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.342957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.343734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.344371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.462525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:18.463060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:18.469676 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.470129 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.470965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:18.471397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:18.494362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:18.504871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a64fe60f-7bba-40cc-b7c7-4493cfb17ed7 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.179192 Jun 16 00:40:18.509411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 340/667] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:18 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:18.643604 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:18.652215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:18.654032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:18.656828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b0e45296-b814-4251-8e05-11267c53c82f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.197974 Jun 16 00:40:18.657824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 328/668] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:18 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:19.521639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:19.522253 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:19.528926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.529381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.530150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.530587 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.683556 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:19.684854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:19.707286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.709264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.710203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:19.710649 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:19.718147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.727790 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-668d0bd6-73ce-48b8-a108-76c123fe4c67 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.209847 Jun 16 00:40:19.732864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 341/669] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:19 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:19.983115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.993667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.994076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:19.995261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c9ef5823-9b2b-4b40-ac83-7877b06d9619 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.324018 Jun 16 00:40:19.996025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 329/670] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:19 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:20.744960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:20.745660 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:20.753264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.753994 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:20.754986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:20.755432 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:20.910977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:20.918984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f1970459-a70c-471a-8e1a-ac1fdc90aa43 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.177857 Jun 16 00:40:20.929273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 342/671] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:20 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:21.013797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:21.014466 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:21.021312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.022272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.023066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.023506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.256547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:21.268568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:21.272249 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:21.274523 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2531ae1c-0199-4d5e-bcc2-4709608b4345 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.264441 Jun 16 00:40:21.275848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 330/672] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:21 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:21.936349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:21.937534 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:21.944763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.958217 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:21.962539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:21.962539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.132246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.144008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1e019877-678f-43a7-ad29-cd4d4def7774 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1520 microversion: 2.1 time: 0.211605 Jun 16 00:40:22.144776 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 343/673] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:21 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:22.242184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-30ae562f-f336-4383-928c-78884f0a0bbf req-2f8605f2-88ab-40d1-91a4-1e6673f5844f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99af546-f8bc-4967-b251-7e486805f7f7", "name": "network-vif-deleted", "tag": "ef72a429-cef2-411d-909d-196a4e3ab735"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:22.255965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-30ae562f-f336-4383-928c-78884f0a0bbf req-2f8605f2-88ab-40d1-91a4-1e6673f5844f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.256780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-30ae562f-f336-4383-928c-78884f0a0bbf req-2f8605f2-88ab-40d1-91a4-1e6673f5844f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.268855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-30ae562f-f336-4383-928c-78884f0a0bbf req-2f8605f2-88ab-40d1-91a4-1e6673f5844f service nova] Creating event network-vif-deleted:ef72a429-cef2-411d-909d-196a4e3ab735 for instance b99af546-f8bc-4967-b251-7e486805f7f7 on hv-cinder-80382 Jun 16 00:40:22.274213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-30ae562f-f336-4383-928c-78884f0a0bbf req-2f8605f2-88ab-40d1-91a4-1e6673f5844f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040617 Jun 16 00:40:22.274903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 331/674] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:22.293884 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:22.294538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:22.301569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.302017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.302782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:22.303218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:22.459157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.482726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.487086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:22.491093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-28c3d6da-80ba-4cc9-b7ca-e36a0d67b5c9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.201383 Jun 16 00:40:22.497374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 344/675] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:22 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:23.162479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:23.163176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:23.169888 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.170348 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.171123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.171566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.236570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.237121 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.237649 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lazy-loading 'fault' on Instance uuid b99af546-f8bc-4967-b251-7e486805f7f7 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:40:23.294738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dcfb252f0d44a280b3448094883e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e7be42e39248e4b9f5c89e96a6b82e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:23.302666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-30821aef-bb60-4c26-a0c5-2fd955e39b53 tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 200 len: 1311 microversion: 2.1 time: 0.144567 Jun 16 00:40:23.313672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 332/676] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:23 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 1311 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:23.513664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:23.514283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:23.522152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.522608 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.523577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:23.524187 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:23.672477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:23.682694 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:23.684231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:23.686912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2307bf11-1e4c-47c0-923d-09233da15ac3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.175859 Jun 16 00:40:23.686912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 345/677] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:23 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:24.320814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:24.322340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] [instance: b99af546-f8bc-4967-b251-7e486805f7f7] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:24.329238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.329709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.330496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.330920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.348017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] HTTP exception thrown: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Request method failure captured: Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 HTTP/1.1 Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqut7v3ybWuAnrqMcwjd_4c8R3L_IH68MNR5jafHKKTh49sm50FoSRXqCiOJobjLW9BpA0h-S7ruzCdwqpL0kg0NFc04RbG98gNfkfCDCcFZL5PdzyZLcWBQRXTM5kWwv4_cCdovYl8vuA3s9obwbYWEaTzMAWMbiX5JyZOrCAOw8g Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:40:24.349273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a4e7be42e39248e4b9f5c89e96a6b82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a4e7be42e39248e4b9f5c89e96a6b82e"}]}] Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: a4e7be42e39248e4b9f5c89e96a6b82e Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1775670217 Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: c9dcfb252f0d44a280b3448094883e13 Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1775670217-project Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. Jun 16 00:40:24.350875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'b99af546-f8bc-4967-b251-7e486805f7f7'} Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:40:24.351681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. Jun 16 00:40:24.360753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:40:24.363206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] Returning 404 to user: Instance b99af546-f8bc-4967-b251-7e486805f7f7 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:40:24.363206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-086c2106-73ea-44dd-aa77-a6f08c5c6b3a tempest-ServerRescueNegativeTestJSON-1775670217 tempest-ServerRescueNegativeTestJSON-1775670217-project] 10.222.0.20 "GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7" status: 404 len: 111 microversion: 2.1 time: 0.034125 Jun 16 00:40:24.363206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 333/678] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:24 2022] GET /compute/v2.1/servers/b99af546-f8bc-4967-b251-7e486805f7f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:40:24.704965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:24.706729 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:24.716301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.721279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.722365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:24.725068 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:24.916628 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:24.929867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:24.931650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:24.933350 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c80e5101-b7c6-48f4-9c8d-12685967c4e3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.232693 Jun 16 00:40:24.935188 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 346/679] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:24 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:25.959412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:25.960223 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:25.970581 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:25.973349 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:25.976800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:25.978256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:26.251964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:26.276617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:26.284301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:26.286100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b6fc4a64-2cd3-408c-aa16-e1dbdc9647a7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.333798 Jun 16 00:40:26.286989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 334/680] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:25 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:27.304150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:27.305474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:27.316681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:27.317135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:27.317912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:27.318607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:27.329648 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:27.522095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:27.531351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:27.533062 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:27.534562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-985dbc45-a88b-4d39-95d1-7c6db6540751 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.235192 Jun 16 00:40:27.535762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 347/681] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:27 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:28.554977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:28.556551 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:28.563439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:28.564155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:28.565203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:28.565700 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:28.746159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:28.764546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:28.774016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:28.776257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d57101dd-9165-478d-a24b-b2380381e8ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.225123 Jun 16 00:40:28.789174 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 335/682] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:28 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:29.795715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:29.798733 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:29.819367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:29.819945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:29.821560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:29.823600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:30.123962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:30.149897 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:30.152085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:30.156282 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-54fc516b-ec3e-475a-a023-c0605e1b9a14 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.364316 Jun 16 00:40:30.156882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 348/683] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:29 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:31.178278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:31.179833 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:31.189016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.189816 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.191042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:31.191566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:31.355057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:31.364512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:31.366039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:31.367219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-61aa5db6-8714-4182-a63a-f99af84e2f8a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.196931 Jun 16 00:40:31.368135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 336/684] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:31 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:32.389784 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:32.395120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:32.401190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:32.402229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:32.403004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:32.403438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:32.556959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:32.567522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:32.569472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:32.570766 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d56ada68-90f8-4b7f-ba7e-5d27a2985177 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.185899 Jun 16 00:40:32.571397 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 349/685] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:32 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:33.599780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:33.600427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:33.609130 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:33.609821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:33.610590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:33.611246 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:33.764331 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:33.774615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:33.777077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:33.778837 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d76f9d05-5df0-4e33-bc42-002e35fdb261 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.192963 Jun 16 00:40:33.779492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 337/686] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:33 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:34.797224 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:34.797873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:34.804970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:34.805436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:34.806204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:34.806666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:34.940993 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:34.949420 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:34.950975 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:34.952164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-07ecb909-5d31-4759-b4f7-97f6e0d4ad73 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.158997 Jun 16 00:40:34.952751 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 350/687] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:34 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:35.970919 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:35.971528 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:35.977993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:35.978448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:35.979226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:35.979665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:36.009909 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-270aa2af-9a02-459a-9050-c9df181598cd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'create', calling method: .version_select at 0x7f2a7b2cfee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-728561768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO452uMEml7wuYxY7SH5FQ8IJf6Naws9rsapCdXREdoadfntL8RMjDTOjAEB9HV7xEVHVmRe0kZEyhEuOlI5BxNV1HBiwF/+2Y3YrEO2ECs7eDEdphoxyLz3ERr3Mrltmg=="}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:36.024174 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-270aa2af-9a02-459a-9050-c9df181598cd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Getting quotas for project ad47d922a30a4c55a781c52c5bd5236f. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:40:36.032041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-270aa2af-9a02-459a-9050-c9df181598cd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Getting quotas for user f2aa1b8204b1494589e096ad775ce4d9 and project ad47d922a30a4c55a781c52c5bd5236f. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:40:36.102856 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-270aa2af-9a02-459a-9050-c9df181598cd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.096664 Jun 16 00:40:36.103556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 351/688] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:40:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:40:36.115887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:36.123542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:36.125065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:36.126207 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-41b0d0fc-46a7-4fe5-adb0-6e32fb123081 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.159297 Jun 16 00:40:36.126758 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 338/689] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:35 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:36.199676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1321148023", "imageRef": "3a4fb3ba-7f90-40c4-ab4d-0cade4fb466b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-728561768", "networks": [{"uuid": "ddc3f874-dd28-4dc7-b3dc-474b8dd70acf"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:36.249390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] validate_networks() for [('ddc3f874-dd28-4dc7-b3dc-474b8dd70acf', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:40:36.697370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:40:36.697799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:40:36.698274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:40:36.698683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:40:36.699094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:40:36.708256 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:36.708745 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:36.709543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:36.709981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:36.726617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Getting quotas for project ad47d922a30a4c55a781c52c5bd5236f. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:40:36.730795 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Getting quotas for user f2aa1b8204b1494589e096ad775ce4d9 and project ad47d922a30a4c55a781c52c5bd5236f. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:40:36.741776 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:40:36.743958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a4fb3ba-7f90-40c4-ab4d-0cade4fb466b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:40:36.880681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9b3e7f02-1c0b-4639-96c0-8cea0496caf8 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684712 Jun 16 00:40:36.881321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 352/690] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:40:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:40:36.891549 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-786305fe-aa67-4eb0-bcda-3bfc629641b5 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:36.892157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-786305fe-aa67-4eb0-bcda-3bfc629641b5 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:36.951534 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-786305fe-aa67-4eb0-bcda-3bfc629641b5 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:36.958865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-786305fe-aa67-4eb0-bcda-3bfc629641b5 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1258 microversion: 2.1 time: 0.071632 Jun 16 00:40:36.959609 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 339/691] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:36 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:37.144706 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:37.145371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:37.151999 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:37.152694 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:37.153670 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:37.154116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:37.495541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:37.506202 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:37.508880 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:37.511242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d7e5bac5-f7c8-4ad9-a92b-1c95fe3a5ccc tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.371245 Jun 16 00:40:37.512307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 353/692] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:37 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:37.976205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-32da6a02-58a6-43ee-b39a-cd3f1ade9937 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:37.976861 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-32da6a02-58a6-43ee-b39a-cd3f1ade9937 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:38.029657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-32da6a02-58a6-43ee-b39a-cd3f1ade9937 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:38.037086 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-32da6a02-58a6-43ee-b39a-cd3f1ade9937 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1258 microversion: 2.1 time: 0.064738 Jun 16 00:40:38.037639 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 340/693] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:37 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:38.529840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:38.530442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:38.536915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:38.537363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:38.538116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:38.538550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:38.664266 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:38.672726 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:38.674230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:38.675385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3c77ce97-46b1-453f-9269-d3c8c8ac9474 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.149442 Jun 16 00:40:38.675937 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 354/694] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:38 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:39.054162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:39.054771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:39.061281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.061731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:39.062481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.062915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:39.125519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:39.132851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e7b61c9d-a2b1-452b-ae31-1fba3568a49c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1262 microversion: 2.1 time: 0.082451 Jun 16 00:40:39.133414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 341/695] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:39 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:39.693790 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:39.694392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:39.700820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.701269 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:39.702014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:39.702444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:39.830631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:39.838465 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:39.839954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:39.841128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d6743f97-f2f8-4882-a039-05eefcc77c0d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.151476 Jun 16 00:40:39.841671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 355/696] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:39 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:40.149370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:40.150092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:40.157173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:40.157639 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:40.158404 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:40.158841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:40.220013 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:40.227438 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c39c6ad8-8633-423d-8577-dcf68a16cf13 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1262 microversion: 2.1 time: 0.081876 Jun 16 00:40:40.227991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 342/697] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:40 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:40.859333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:40.860498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:40.867087 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:40.867536 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:40.868311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:40.868777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:40.995815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:41.003894 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:41.005469 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:41.006634 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7c600f05-02cc-4c5a-9cc3-dea87ad2a68e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.151505 Jun 16 00:40:41.007188 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 356/698] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:40 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:41.243106 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:41.243640 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:41.250077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:41.251125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:41.251876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:41.252314 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:41.313674 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:41.321276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b90e2255-6ab2-4479-8610-b20896cf84bb tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1310 microversion: 2.1 time: 0.082082 Jun 16 00:40:41.321830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 343/699] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:41 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:42.034041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:42.034655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:42.044057 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.044543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.045679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.046299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.191647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:42.205785 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:42.207581 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:42.209020 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-74ad77a6-9616-42b3-8162-f35bd411f5fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.180652 Jun 16 00:40:42.209729 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 357/700] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:42 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:42.338522 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:42.345944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:42.351994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.352459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.353287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:42.353731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:42.721917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:42.738038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-830fa38e-096e-4b1c-bdd5-f7cad9568f8c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.402763 Jun 16 00:40:42.739307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 344/701] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:42 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:43.231355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:43.232244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:43.251377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.252257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.254817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.256445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.432319 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-4783c062-148e-45e9-8a76-dc1cf0364499 req-93faf7f3-f483-48d8-a533-b460e311afc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:43.465249 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4783c062-148e-45e9-8a76-dc1cf0364499 req-93faf7f3-f483-48d8-a533-b460e311afc2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.467372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4783c062-148e-45e9-8a76-dc1cf0364499 req-93faf7f3-f483-48d8-a533-b460e311afc2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.516140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-4783c062-148e-45e9-8a76-dc1cf0364499 req-93faf7f3-f483-48d8-a533-b460e311afc2 service nova] Creating event network-changed:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:40:43.521967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-4783c062-148e-45e9-8a76-dc1cf0364499 req-93faf7f3-f483-48d8-a533-b460e311afc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094788 Jun 16 00:40:43.523138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 345/702] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:43.530170 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:43.550735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:43.553484 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:43.557937 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c3a5398a-c2f6-4e80-932a-def79618d0ab tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.331107 Jun 16 00:40:43.558924 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 358/703] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:43 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:43.757987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:43.759039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:43.774243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.776086 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.778567 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:43.781921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:43.821944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:43.970005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:43.978453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e65ed631-1fb8-460b-a030-fe064f7edeb1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.226578 Jun 16 00:40:43.988733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 346/704] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:43 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:44.576958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:44.578208 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:44.585405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:44.585867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:44.586683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:44.587127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:44.728535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:44.737194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:44.738909 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:44.740159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bd91626f-d6ae-4683-835a-a07e0a6031ee tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.167271 Jun 16 00:40:44.741033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 359/705] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:44 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:44.995448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:44.996057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:45.003885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.004333 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.005131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.005564 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.194901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:45.207340 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2025fbd6-7a71-41f0-b863-49d299bd2d5d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.215669 Jun 16 00:40:45.209127 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 347/706] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:44 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:45.448726 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:45.449241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:45.456405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.456974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.457949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.458604 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.481978 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-a0e0bf33-272b-42ee-8eb2-28c8e75183f9 req-1fec4b8f-7e35-4d6d-baa7-afd0b495b6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "name": "network-vif-plugged", "status": "completed", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:45.497125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a0e0bf33-272b-42ee-8eb2-28c8e75183f9 req-1fec4b8f-7e35-4d6d-baa7-afd0b495b6fe service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.497617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a0e0bf33-272b-42ee-8eb2-28c8e75183f9 req-1fec4b8f-7e35-4d6d-baa7-afd0b495b6fe service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.510892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-694a55f7-e639-4cf0-82b2-59955facd162 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/ips" status: 200 len: 150 microversion: 2.1 time: 0.066788 Jun 16 00:40:45.512499 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 348/707] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:40:45 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:45.514599 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-a0e0bf33-272b-42ee-8eb2-28c8e75183f9 req-1fec4b8f-7e35-4d6d-baa7-afd0b495b6fe service nova] Creating event network-vif-plugged:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:40:45.522193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-a0e0bf33-272b-42ee-8eb2-28c8e75183f9 req-1fec4b8f-7e35-4d6d-baa7-afd0b495b6fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267116 Jun 16 00:40:45.522828 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 360/708] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:45.760318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:45.761493 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:45.768842 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.769398 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.770279 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:45.770781 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:45.931752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:45.940170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:45.942042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:45.943219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-47029bbf-0946-408c-a06c-1a795b3444fb tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.187957 Jun 16 00:40:45.944702 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 349/709] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:45 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:46.227021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:46.227799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:46.244346 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.245112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:46.245928 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.246369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:46.424299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:46.433906 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8398a0aa-ef7a-4d6d-bd82-d419ddce7170 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.211435 Jun 16 00:40:46.443406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 361/710] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:46 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:46.964068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:46.966692 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:46.979470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.980048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:46.980939 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:46.981336 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.141525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:47.149718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:47.151373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:47.152555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-de1cbcfe-6f0b-4309-b060-3e7f1980f9e6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.193449 Jun 16 00:40:47.153109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 350/711] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:46 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:47.252757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f4b5415-5d54-4774-bb3d-a7803e14883d"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:47.253874 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:47.255831 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:47.256493 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=10 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:47.257969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:47.263124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:47.263354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.264335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:47.264792 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.453921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:47.454944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:47.461677 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:47.463820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:47.464363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.465399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:47.465952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:47.637986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:47.647900 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-27899b94-bb3e-4313-9a79-fa0c6bee5558 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.199952 Jun 16 00:40:47.655198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 351/712] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:47 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:48.171615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:48.173630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:48.176240 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:48.181301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.181757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.182530 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.182980 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.345159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:48.355884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:48.357627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:48.359104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9784ed99-b055-4368-8e9f-947611ec9580 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.191500 Jun 16 00:40:48.360465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 352/713] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:48 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:48.665679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:48.666298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:48.673767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.674227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.674991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:48.675433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:48.828082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:48.837477 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a21f08cf-495f-45fc-b19e-bb669154e7cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.175246 Jun 16 00:40:48.838634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 353/714] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:48 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:49.378906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:49.379682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:49.386645 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.387108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.387933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.388370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.549667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:49.566862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:49.570765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:49.570765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-430212e1-b335-4528-adee-43cae0782238 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.195277 Jun 16 00:40:49.570765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 354/715] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:49 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:49.855425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:49.856042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:49.862744 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.863426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:49.864383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:49.865002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:50.006292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:50.014317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fa3bacea-7982-4ec0-b092-358628761f0d tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.162688 Jun 16 00:40:50.027047 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 355/716] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:49 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:50.592699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:50.594698 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:50.602071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:50.602590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:50.603429 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:50.603952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:50.769339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:50.777289 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:50.778868 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:50.780004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a16ac2da-4ec9-4955-8231-c0cbb61a127d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1744 microversion: 2.20 time: 0.192612 Jun 16 00:40:50.780571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 356/717] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:50 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:40:51.032911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:51.034061 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:51.042946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.043604 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:51.044805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.045311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:51.324986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:51.333039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cc914a8f-618e-4c9d-866d-c679df69e57c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.304875 Jun 16 00:40:51.342097 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 357/718] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:51 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:51.507995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-28b97f2d-49f9-4fb3-bda9-0a27d95bf46a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "POST /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.259379 Jun 16 00:40:51.514580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 362/719] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:40:47 2022] POST /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments => generated 194 bytes in 4261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:51.799606 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:51.800052 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:51.810915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.811656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:51.812453 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:51.813956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:52.136543 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:52.145337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:52.149629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:52.149629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-18e84204-9aad-46de-a758-25b244dfd57f tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.353281 Jun 16 00:40:52.159696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 358/720] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:51 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:52.351687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:52.352942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:52.360127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:52.360974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:52.362029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:52.364378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:52.706582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:52.706582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-856bc485-88ba-4594-97dd-20357b5ef652 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.178985 Jun 16 00:40:52.706582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 363/721] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:52 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:53.167152 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:53.167770 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:53.178394 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:53.178846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:53.179629 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:53.180064 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:53.333827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:53.345157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:53.348034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:53.348186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-534c01dc-066a-45bc-b885-35cc80a83807 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.184917 Jun 16 00:40:53.348735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 359/722] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:53 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:53.712362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:53.713377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:53.721158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:53.722434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:53.723871 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:53.724625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:53.884468 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:53.887457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:53.893936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6134d300-83b7-4dd1-a45d-eecdabe09b97 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.187388 Jun 16 00:40:53.896303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 364/723] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:53 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:54.367939 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:54.369215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:54.376213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:54.376925 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:54.377903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:54.378599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:54.573410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:54.582194 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:54.584209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:54.585427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-286cb124-edb0-4894-92d1-64f0166a7a82 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.222604 Jun 16 00:40:54.585990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 360/724] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:54 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:54.911630 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:54.912204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:54.919058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:54.919527 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:54.920288 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:54.920749 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:55.087071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:55.094758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e6c23142-65e7-4be6-b933-6d13c1427abe tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.188268 Jun 16 00:40:55.095310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 365/725] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:54 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:55.611995 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:55.612491 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:55.624872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:55.625859 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:55.626637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:55.627071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:55.813788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:55.825776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:55.827548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:55.829668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f68022a4-7944-48de-9077-c5ce7b026c0a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.229611 Jun 16 00:40:55.836729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 361/726] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:55 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:56.113315 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:56.113892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:56.125982 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:56.127076 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:56.129080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:56.129632 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:56.316973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:56.326461 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bb46a02d-6bdd-42df-85e3-dd4c8ac9b6d1 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.218922 Jun 16 00:40:56.332080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 366/727] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:56 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:56.851278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:56.851864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:56.858822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:56.860184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:56.861260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:56.861974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:57.041561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:57.051339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:57.053029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:57.054183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d91a6f2a-ca23-42b2-b782-d9a514da34bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.210807 Jun 16 00:40:57.054921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 362/728] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:56 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:57.343279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:57.344055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:57.352551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:57.353151 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:57.354026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:57.354539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:57.651402 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:57.663326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-04fbb177-cad7-4652-9e2c-b1bcf6ad560c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.323806 Jun 16 00:40:57.663908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 367/729] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:57 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:40:58.073260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:58.073984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:58.081225 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:58.081680 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:58.082455 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:58.082893 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:58.085570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=100 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:58.219683 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:58.227500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:58.229057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:58.230210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9c1937e1-37d1-46f9-b462-081aaf4c1492 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.161363 Jun 16 00:40:58.230769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 363/730] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:58 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:58.681244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:58.682196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:58.689500 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:58.689952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:58.690710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:58.691307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:58.845276 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:58.868990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8d3996c3-0c51-4938-95bb-df444b9752cf tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.190962 Jun 16 00:40:58.876829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 368/731] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:58 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:40:59.249862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:59.250961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:59.268226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:59.268732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:59.273178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:59.273624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:59.411969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-d41ff5e0-8270-445b-8119-91e735bb0fef req-3a0d51be-d9a2-4fa8-a825-dc9801bd91f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "name": "network-vif-plugged", "status": "completed", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:40:59.430585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-d41ff5e0-8270-445b-8119-91e735bb0fef req-3a0d51be-d9a2-4fa8-a825-dc9801bd91f2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:59.430585 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-d41ff5e0-8270-445b-8119-91e735bb0fef req-3a0d51be-d9a2-4fa8-a825-dc9801bd91f2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:59.433108 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-d41ff5e0-8270-445b-8119-91e735bb0fef req-3a0d51be-d9a2-4fa8-a825-dc9801bd91f2 service nova] Creating event network-vif-plugged:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:40:59.442359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-d41ff5e0-8270-445b-8119-91e735bb0fef req-3a0d51be-d9a2-4fa8-a825-dc9801bd91f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034886 Jun 16 00:40:59.445099 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 369/732] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:40:59.530731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:59.540072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:59.541978 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:40:59.543547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-54ba708c-0bf2-4cd2-ba3c-836014c25547 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.298561 Jun 16 00:40:59.544641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 364/733] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:40:59 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:40:59.890081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:40:59.891119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:40:59.899845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:59.900434 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:40:59.901385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:40:59.901947 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:00.120340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:00.132699 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fdc1c702-5334-451a-a33a-c570fded6089 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.247372 Jun 16 00:41:00.136717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 370/734] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:40:59 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:00.561631 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:00.562258 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:00.574743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:00.575478 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:00.586845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:00.587590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:00.781544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:00.791684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:00.793220 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:00.794796 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3363ed07-1353-4337-bfc7-5e1a3c7a8697 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.237018 Jun 16 00:41:00.800935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 365/735] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:00 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:01.150067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:01.151841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:01.162011 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.162797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.164673 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.169392 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.285550 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:01.286374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:01.293032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.297602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.297602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.297602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.367185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:01.377405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5a8b7b4b-4392-45c8-b3ad-44e8d50229df tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1358 microversion: 2.1 time: 0.231267 Jun 16 00:41:01.379285 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 371/736] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:01 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:01.426883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'services' on Instance uuid 90f013d4-e901-45ae-9bce-c0d5f28dfd77 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:41:01.815962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:01.816615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:01.823236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.823686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.824538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.825058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.958181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a419f21e-9a9d-46e1-81dc-ba1f4e3e288b tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments/7f4b5415-5d54-4774-bb3d-a7803e14883d" status: 202 len: 0 microversion: 2.1 time: 0.676666 Jun 16 00:41:01.961731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 366/737] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:41:01 2022] DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments/7f4b5415-5d54-4774-bb3d-a7803e14883d => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:41:01.971977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:01.973981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:01.980472 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.981025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.981858 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:01.982386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:01.999051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:01.999051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:02.000622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:02.001949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b91643f5-58d5-4b17-a0cb-34ec3da47f89 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.190813 Jun 16 00:41:02.002562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 372/738] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:01 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:02.014095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a59c025b-d205-4f3b-ab15-cecd62ef25e9 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049937 Jun 16 00:41:02.014772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 367/739] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:01 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:41:02.396597 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:02.397209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:02.408456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.409248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.410040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.410908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.588125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:02.599579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3c11bbf3-d5a4-4a70-b0ad-59b7d48f84a6 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1549 microversion: 2.1 time: 0.207533 Jun 16 00:41:02.600479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 373/740] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:02 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:02.617916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:02.618540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:02.632485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.632979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.633776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.634233 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.803512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:02.811907 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0f3c8758-655d-4495-b006-c48f05ea7e09 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1549 microversion: 2.1 time: 0.198216 Jun 16 00:41:02.812543 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 368/741] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:02 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:02.830203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:02.833774 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:02.834737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Searching by: {'deleted': False, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f'} {{(pid=124721) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 00:41:02.842085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.842242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.843068 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:02.843519 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:02.939044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.multi_cell_list [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124721) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 00:41:03.021503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:03.022046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:03.027766 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.028213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.028994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.029427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.047844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1e3ffd9e-0924-43ff-b446-02cd64b1199b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.223472 Jun 16 00:41:03.048439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 374/742] 10.222.0.20 () {58 vars in 1124 bytes} [Thu Jun 16 00:41:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:03.052995 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:03.053893 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:03.059676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.060121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.060912 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.061345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.092179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1e1e551a-73f3-4f4c-bba8-aa3e1f0e9f6a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Jun 16 00:41:03.092469 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 375/743] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:03 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:03.096626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:03.097219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:03.102915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.103371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.104121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:03.104574 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:03.181746 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:03.186159 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:03.188292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:03.190298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0f45f6a3-0b56-46b3-acd8-6675aa081735 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1739 microversion: 2.20 time: 0.173183 Jun 16 00:41:03.191191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 369/744] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:03 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:03.256992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:03.264639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-83ed0d9b-6965-43c4-b1d4-d3b44bc86f2f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1549 microversion: 2.1 time: 0.171405 Jun 16 00:41:03.265304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 376/745] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:03 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:04.102788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:04.103792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:04.111129 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.111809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.112428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.113010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.141963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-79bd96cf-91ee-4a62-802a-3be585c3fd73 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043006 Jun 16 00:41:04.142529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 370/746] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:41:04 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:41:04.205830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:04.206328 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:04.212056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:04.213135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.213636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.214452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:04.214577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.215073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.221462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.225277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.225277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.225277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.260197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:41:04.437704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:04.445496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:04.446983 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:04.448136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1d8832a3-d359-46dd-a89d-0619b2603781 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1721 microversion: 2.20 time: 0.242895 Jun 16 00:41:04.448785 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 371/747] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:04 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:04.576805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e260eef8-c76b-43ce-a0bb-74055b51657d tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 204 len: 0 microversion: 2.1 time: 0.373781 Jun 16 00:41:04.576805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 377/748] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:04 2022] DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:41:04.585111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:04.585735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:04.592628 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.593298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.594430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:04.595066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:04.728177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:04.736656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c468bf3a-1457-4035-b9b0-211b767c8915 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1682 microversion: 2.1 time: 0.156162 Jun 16 00:41:04.737211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 372/749] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:04 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:05.211266 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:05.212557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:05.219060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.219623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.220430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.220882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.468212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:05.469953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:05.476616 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.477068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.477925 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.478360 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.609073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:05.621393 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:05.622963 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:05.624155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-73c354b5-0216-460a-b058-241d707259c7 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1721 microversion: 2.20 time: 0.160039 Jun 16 00:41:05.624768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 373/750] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:05 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:05.753635 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:05.754249 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:05.760150 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.760636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.761476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:05.761921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:05.941820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:05.949795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cad238bb-ae4b-4da0-9b73-f8fc77db5239 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1682 microversion: 2.1 time: 0.199897 Jun 16 00:41:05.950361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 374/751] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:05 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:41:06.547989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:06.618252 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-72b27ff9-3441-4d0e-8c51-6e822cbd51af tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.411277 Jun 16 00:41:06.623191 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 378/752] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:41:05 2022] POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments => generated 194 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:06.642538 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:06.646569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:06.651519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.652268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:06.654833 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.655436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:06.800201 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:06.808094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:06.812934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:06.812934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-516b5a2d-8c31-4dbd-88ed-4dab6d3c37b5 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1721 microversion: 2.20 time: 0.172635 Jun 16 00:41:06.812934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 375/753] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:06 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:06.968550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:06.969258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:06.976247 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.976734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:06.977516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:06.977925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:07.106255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:07.114217 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d3658560-f076-4806-a45f-23dcced5fc1e tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1682 microversion: 2.1 time: 0.150655 Jun 16 00:41:07.114804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 379/754] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:06 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:07.830444 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:07.830966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:07.837517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:07.837974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:07.838830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:07.839267 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:08.079025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:08.088192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:08.089851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:08.091591 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b30e87eb-915e-4685-8efb-b03fecd6b92b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1721 microversion: 2.20 time: 0.265794 Jun 16 00:41:08.104191 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 376/755] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:07 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:08.131633 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:08.132313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:08.141219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:08.141919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:08.142882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:08.143487 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:08.306860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:08.314822 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a6f19bf3-192b-4b69-9fcc-fb8a00222474 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1682 microversion: 2.1 time: 0.187186 Jun 16 00:41:08.315477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 380/756] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:08 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:08.773944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-0b58a151-7faf-4894-a190-8a13f931f138 req-5361911e-b5d2-4c2c-a3fc-37a409fce645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f013d4-e901-45ae-9bce-c0d5f28dfd77", "name": "network-vif-deleted", "tag": "cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:08.786190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-0b58a151-7faf-4894-a190-8a13f931f138 req-5361911e-b5d2-4c2c-a3fc-37a409fce645 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:08.789696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-0b58a151-7faf-4894-a190-8a13f931f138 req-5361911e-b5d2-4c2c-a3fc-37a409fce645 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:08.799233 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-0b58a151-7faf-4894-a190-8a13f931f138 req-5361911e-b5d2-4c2c-a3fc-37a409fce645 service nova] Creating event network-vif-deleted:cbfc7adb-aa8f-4b8b-ad6b-4d6609ed6698 for instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 on hv-cinder-80382 Jun 16 00:41:08.804888 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-0b58a151-7faf-4894-a190-8a13f931f138 req-5361911e-b5d2-4c2c-a3fc-37a409fce645 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037685 Jun 16 00:41:08.805437 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 377/757] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:09.111696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:09.112230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:09.118780 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.119234 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.120015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.120454 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.270717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:09.278636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:09.280112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:09.281578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-385e9f2d-c31e-4087-b619-d988d38e3ac4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1664 microversion: 2.20 time: 0.174123 Jun 16 00:41:09.282245 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 381/758] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:09 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:09.300903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b429fad-970c-4d1e-9e5e-b45fcfdfc6fb"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:09.302791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:09.309958 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.310445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.311214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.311656 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.332237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:09.333789 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:09.340882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.341338 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.342145 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.342601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.410223 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.411018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.411431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lazy-loading 'fault' on Instance uuid 90f013d4-e901-45ae-9bce-c0d5f28dfd77 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:41:09.471998 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052ae1db33014bb5915dc228f1b76d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45031128a55e42989da61e01948538d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:09.479419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f97869ee-ea85-4822-8470-d032c9a1c82f tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 200 len: 1332 microversion: 2.1 time: 0.151416 Jun 16 00:41:09.490306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 382/759] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:09 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:41:09.495166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-4ad76028-bf9c-43c6-b986-3b1ec2a84054 req-75e00e2f-b338-4f22-b7fd-bfd9ae3c26cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "name": "network-vif-unplugged", "status": "completed", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:09.504367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-4ad76028-bf9c-43c6-b986-3b1ec2a84054 req-75e00e2f-b338-4f22-b7fd-bfd9ae3c26cc service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:09.505786 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-4ad76028-bf9c-43c6-b986-3b1ec2a84054 req-75e00e2f-b338-4f22-b7fd-bfd9ae3c26cc service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:09.516850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.compute.server_external_events [req-4ad76028-bf9c-43c6-b986-3b1ec2a84054 req-75e00e2f-b338-4f22-b7fd-bfd9ae3c26cc service nova] Unable to find a host for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d. Dropping event network-vif-unplugged {{(pid=124721) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:41:09.517950 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-4ad76028-bf9c-43c6-b986-3b1ec2a84054 req-75e00e2f-b338-4f22-b7fd-bfd9ae3c26cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029800 Jun 16 00:41:09.519045 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 383/760] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:41:09.864322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:10.415584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c41146c4-2d98-414e-9d6d-34e41246cd91 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.119602 Jun 16 00:41:10.420853 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 378/761] 10.222.0.20 () {62 vars in 1363 bytes} [Thu Jun 16 00:41:09 2022] POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments => generated 188 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 00:41:10.496480 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:10.497630 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:10.507970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:10.508704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:10.509735 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:10.510390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:10.529150 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 HTTP/1.1 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:41:10.530917 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:10.532914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '90f013d4-e901-45ae-9bce-c0d5f28dfd77'} Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:10.533811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:10.535080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:10.536268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:10.536268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b92c22e3-c8ba-4dc2-8b7f-821fd1faffca tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 404 len: 111 microversion: 2.1 time: 0.040161 Jun 16 00:41:10.536268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 384/762] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:10 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:10.541935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d6e2a805-c224-4134-969f-e487c11ba017 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '.version_select at 0x7f2a83c968b0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:10.574272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:10.574757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:10.581022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:10.581468 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:10.582231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:10.582664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:10.617321 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d6e2a805-c224-4134-969f-e487c11ba017 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173656705" status: 202 len: 0 microversion: 2.1 time: 0.079224 Jun 16 00:41:10.617902 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 379/763] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Jun 16 00:41:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173656705 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:11.293948 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f57ac5c4-0216-4dcb-b52f-797f5158dc47 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments/4b429fad-970c-4d1e-9e5e-b45fcfdfc6fb" status: 202 len: 0 microversion: 2.20 time: 0.723439 Jun 16 00:41:11.294667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 385/764] 10.222.0.20 () {60 vars in 1456 bytes} [Thu Jun 16 00:41:10 2022] DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments/4b429fad-970c-4d1e-9e5e-b45fcfdfc6fb => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:41:11.356646 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:11.357217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:11.363242 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:11.363994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:11.364443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:11.364917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:11.820744 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1ade4a7f-14eb-4ffb-9668-da991a0f9d56 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/action" status: 202 len: 0 microversion: 2.20 time: 0.468501 Jun 16 00:41:11.824441 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 380/765] 10.222.0.20 () {62 vars in 1318 bytes} [Thu Jun 16 00:41:11 2022] POST /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 00:41:11.830507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:11.832303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:11.840439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:11.841032 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:11.841801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:11.842325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:11.979499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:11.989242 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:11.990883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:11.992907 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5e0b98ac-2550-488a-8ae4-e3c69db4dd21 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1672 microversion: 2.20 time: 0.166826 Jun 16 00:41:11.993438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 386/766] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:11 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:12.873536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:12.874115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:12.880703 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:12.881143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:12.881904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:12.882339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:12.896429 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 HTTP/1.1 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:12.898103 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.899439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '90f013d4-e901-45ae-9bce-c0d5f28dfd77'} Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:12.900476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.902446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.904338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:12.904338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9776b5cd-a0a9-40bd-a794-cab4239c08bd tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 404 len: 111 microversion: 2.1 time: 0.030483 Jun 16 00:41:12.904338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 381/767] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:12 2022] DELETE /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:12.909879 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:12.910512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: 90f013d4-e901-45ae-9bce-c0d5f28dfd77] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:12.913205 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:12.918758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:12.919214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:12.919983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:12.920635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:12.936948 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 HTTP/1.1 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:41:12.939231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.940612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '90f013d4-e901-45ae-9bce-c0d5f28dfd77'} Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:12.941406 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. Jun 16 00:41:12.943222 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:12.944696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance 90f013d4-e901-45ae-9bce-c0d5f28dfd77 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:12.944696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-13b35ca9-5b49-4ffe-a91a-47f4ff9f4b36 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77" status: 404 len: 111 microversion: 2.1 time: 0.036891 Jun 16 00:41:12.944696 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 387/768] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:12 2022] GET /compute/v2.1/servers/90f013d4-e901-45ae-9bce-c0d5f28dfd77 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:13.013093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:13.013695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:13.021542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:13.025903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:13.025903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:13.025903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:13.195945 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:13.204780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:13.207535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:13.208986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3d694157-8f4f-46cd-92fa-168274283f27 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1672 microversion: 2.20 time: 0.199854 Jun 16 00:41:13.209714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 382/769] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:13 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:14.228119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:14.228797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:14.235826 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.236278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.237070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.237500 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.271916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:14.272739 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:14.279501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.280033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.280948 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.281459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.297010 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 HTTP/1.1 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:14.298627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.300145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'c9783fec-706a-4ed8-96b9-b5d790347dc8'} Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:14.301044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.302385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.303792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:14.303792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c701db8d-8406-4cf0-93af-d2ae9398d2f6 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 404 len: 111 microversion: 2.1 time: 0.032692 Jun 16 00:41:14.303792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 383/770] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:14 2022] DELETE /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:14.309991 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:14.310747 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: c9783fec-706a-4ed8-96b9-b5d790347dc8] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:14.317182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.317681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.319506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.319951 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.338387 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 HTTP/1.1 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:14.339932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.341916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'c9783fec-706a-4ed8-96b9-b5d790347dc8'} Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:14.342715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. Jun 16 00:41:14.343966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.346281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance c9783fec-706a-4ed8-96b9-b5d790347dc8 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:14.346281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f2649382-4cea-41b7-ab56-468f80a46f1a tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8" status: 404 len: 111 microversion: 2.1 time: 0.035475 Jun 16 00:41:14.346281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 384/771] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:14 2022] GET /compute/v2.1/servers/c9783fec-706a-4ed8-96b9-b5d790347dc8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:14.349939 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:14.350432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:14.356507 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.356990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.357757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.358193 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.371827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d HTTP/1.1 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:14.373442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.374834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'ac529ee5-1040-4f28-acb9-4346e98dba6d'} Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:14.376133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.378400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.379784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:14.379784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2395b9c0-ad06-4bd6-90a4-5475cb5c0d32 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 404 len: 111 microversion: 2.1 time: 0.028726 Jun 16 00:41:14.379784 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 385/772] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:14 2022] DELETE /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:14.384922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:14.385537 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: ac529ee5-1040-4f28-acb9-4346e98dba6d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:14.387547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:14.393409 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.393866 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.394920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:14.395367 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:14.398034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:14.398913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:14.400080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-012d442c-a2be-436f-b205-e820a34cc045 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.176834 Jun 16 00:41:14.400692 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 388/773] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:14 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:14.410935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d HTTP/1.1 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:14.412505 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.413878 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'ac529ee5-1040-4f28-acb9-4346e98dba6d'} Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:14.414625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. Jun 16 00:41:14.416392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:14.417690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance ac529ee5-1040-4f28-acb9-4346e98dba6d could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:14.417690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9dc403d7-afce-485b-a3c8-59f6825b9062 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d" status: 404 len: 111 microversion: 2.1 time: 0.033253 Jun 16 00:41:14.417690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 386/774] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:14 2022] GET /compute/v2.1/servers/ac529ee5-1040-4f28-acb9-4346e98dba6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:15.420045 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.420678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.421433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.422345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.429027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.429313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.429768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.429935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.430570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.431006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.431248 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.431705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.567641 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:15.575964 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-83675d80-09a4-41a7-8bff-76fb312622c3 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1595 microversion: 2.1 time: 0.158762 Jun 16 00:41:15.576541 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 387/775] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:15 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:15.583880 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:15.595033 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:15.596820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:15.598227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c2714889-66d1-449a-8072-37076dc17de2 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.182909 Jun 16 00:41:15.598561 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 389/776] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:15 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:15.679181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.680355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.691039 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.692129 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.693776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.695075 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 HTTP/1.1 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:15.733942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.736757 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0'} Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:15.740934 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.747458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.759953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:15.759953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6c622d45-f49b-42d4-9379-6c29b2341a91 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 404 len: 111 microversion: 2.1 time: 0.061455 Jun 16 00:41:15.759953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 388/777] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:41:15 2022] DELETE /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:41:15.761357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:15.761357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] [instance: fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:15.761357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.762531 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.763044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:15.763780 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:15.807665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] HTTP exception thrown: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Request method failure captured: Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 HTTP/1.1 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqlkkr7QbJzVgCh9qC6_uDipXApBzmQUVUI8bbhhbZejhJ0gO5rUba_DsbabDYEyagljqyxZdihGecje5jmf9T0hdj5ny3KxIjZkXPWIrMDHWMw0bGzTsmWDqe9EzM0Nr4nK28C3qr_iT2CRlt3iN3Psh7O4X4LPYc3FtAIbJcZJPg Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:41:15.809541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45031128a55e42989da61e01948538d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45031128a55e42989da61e01948538d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45031128a55e42989da61e01948538d3"}]}] Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 45031128a55e42989da61e01948538d3 Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072022260 Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 052ae1db33014bb5915dc228f1b76d5c Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeNegativeTest-1072022260-project Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.811047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0'} Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:15.816041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. Jun 16 00:41:15.817523 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:41:15.819017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] Returning 404 to user: Instance fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:15.819017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-acd689e8-5def-4cad-8cec-b1035904ca71 tempest-AttachVolumeNegativeTest-1072022260 tempest-AttachVolumeNegativeTest-1072022260-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0" status: 404 len: 111 microversion: 2.1 time: 0.072935 Jun 16 00:41:15.819017 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 390/778] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:15 2022] GET /compute/v2.1/servers/fcb3ce76-65b1-48b8-8b1a-3374f6f7c0b0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:16.617212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:16.618588 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:16.637286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:16.637920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:16.638794 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:16.639343 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:16.875666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:16.889977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:16.892229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:16.893736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ac18e264-1799-4db0-9aed-0b1f65e7e276 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.281251 Jun 16 00:41:16.894883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 389/779] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:16 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:17.914763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:17.916041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:17.918426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:17.925335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:17.925778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:17.926560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:17.927003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:18.283185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:18.298694 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:18.300262 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:18.314194 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d1a49d2a-9c94-41e2-81ee-fbd7f90f2ca6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.404540 Jun 16 00:41:18.314796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 391/780] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:17 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:19.333206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:19.333862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:19.340664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:19.342704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:19.343142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:19.343943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:19.345164 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:19.852724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:19.863763 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:19.868886 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:19.870488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-37cefc72-d7ca-43d1-a0e3-0596c9ec3c4d tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.542325 Jun 16 00:41:19.873243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 390/781] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:19 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:19.903992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-ac9bb402-915c-429f-93c1-bd0a7ebf36fa req-8fa3e7b7-3c53-40df-8798-daa2a84f02ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:19.934279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-ac9bb402-915c-429f-93c1-bd0a7ebf36fa req-8fa3e7b7-3c53-40df-8798-daa2a84f02ad service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:19.935006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-ac9bb402-915c-429f-93c1-bd0a7ebf36fa req-8fa3e7b7-3c53-40df-8798-daa2a84f02ad service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:19.959639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-ac9bb402-915c-429f-93c1-bd0a7ebf36fa req-8fa3e7b7-3c53-40df-8798-daa2a84f02ad service nova] Creating event network-changed:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:41:19.978114 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-ac9bb402-915c-429f-93c1-bd0a7ebf36fa req-8fa3e7b7-3c53-40df-8798-daa2a84f02ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079039 Jun 16 00:41:19.978662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 392/782] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:20.895244 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:20.896601 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:20.920779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:20.920779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:20.926243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:20.926722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:21.296603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:21.314309 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:21.315285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:21.316503 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8cc75eb3-e552-4728-b9be-5198457a183b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.429928 Jun 16 00:41:21.317096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 391/783] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:20 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:22.335657 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:22.337617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:22.353577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:22.354050 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:22.354849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:22.355322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:22.731790 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:22.741342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:22.743463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:22.745023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2b52650e-75b7-4421-bd8c-66b3350fd5b3 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.414777 Jun 16 00:41:22.757129 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 393/784] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:22 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:23.663268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-999590129"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:23.663268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:23.670846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:23.671305 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:23.672981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:23.673418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:23.766237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:23.767463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:23.785785 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:23.786704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:23.788052 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:23.788804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:23.913603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.network.security_group_api [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Adding security group 384e488b-4692-4e93-90f7-79fad658ae61 to port 6a0788b7-0528-40f3-80fe-df58bcfaf509 Jun 16 00:41:24.092818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:24.105573 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:24.110750 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:24.112411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f3e72f20-2310-45e9-a17c-f90b2ab2bef6 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.352082 Jun 16 00:41:24.127478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 394/785] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:23 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:24.497822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a300a133-61d7-47e8-9df3-723101020c50 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action" status: 202 len: 0 microversion: 2.1 time: 0.840337 Jun 16 00:41:24.500023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 392/786] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:41:23 2022] POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:24.508200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:24.509139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:24.517412 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:24.522901 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:24.523140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-c481d8d2-56d3-4a94-9c5e-4941c1fd80de req-96f35ea5-3cc8-43c3-b1df-1d158bdd880b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:24.523251 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:24.523251 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:24.538488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-c481d8d2-56d3-4a94-9c5e-4941c1fd80de req-96f35ea5-3cc8-43c3-b1df-1d158bdd880b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:24.538923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-c481d8d2-56d3-4a94-9c5e-4941c1fd80de req-96f35ea5-3cc8-43c3-b1df-1d158bdd880b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:24.568819 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-c481d8d2-56d3-4a94-9c5e-4941c1fd80de req-96f35ea5-3cc8-43c3-b1df-1d158bdd880b service nova] Creating event network-changed:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:41:24.575640 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-c481d8d2-56d3-4a94-9c5e-4941c1fd80de req-96f35ea5-3cc8-43c3-b1df-1d158bdd880b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065740 Jun 16 00:41:24.576832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 393/787] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:24.734918 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:24.738611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:24.744498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-513b2fb4-37d8-4ad6-99b1-6ecac454ef7b tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1641 microversion: 2.1 time: 0.239959 Jun 16 00:41:24.746687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 395/788] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:24 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1641 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:25.146048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:25.146679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:25.152854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.153311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.155440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:25.155440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:25.303613 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:25.311621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:25.313738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:25.315025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-11ab8421-2513-4b85-9800-014bc6e8e4bd tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.173976 Jun 16 00:41:25.316118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 394/789] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:25 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:25.660429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fc519762-eba4-428c-98ef-6e9a01e98454 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Action: 'create', calling method: .version_select at 0x7f2a7b3035e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-724555778", "metadata": {"Type": "work"}}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:26.334545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:26.335339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:26.343791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:26.344246 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:26.345050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:26.345478 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:26.356458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fc519762-eba4-428c-98ef-6e9a01e98454 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.824311 Jun 16 00:41:26.356458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 396/790] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Jun 16 00:41:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 00:41:26.366662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-294ca4db-f9dd-4171-a57c-b7c5c6e91e9c tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a7b282670>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:26.416861 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-294ca4db-f9dd-4171-a57c-b7c5c6e91e9c tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 200 len: 352 microversion: 2.1 time: 0.053943 Jun 16 00:41:26.417425 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 397/791] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:41:26 2022] GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:26.558099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:26.566713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:26.568215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:26.569707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-068e9dc2-eddf-48ec-a271-3431727dc9f1 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.238942 Jun 16 00:41:26.580936 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 395/792] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:26 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:27.429665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-81c6bdaa-0538-47d1-854a-fb87df7648c1 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a7b3b2c10>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.483470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-81c6bdaa-0538-47d1-854a-fb87df7648c1 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 200 len: 353 microversion: 2.1 time: 0.053217 Jun 16 00:41:27.483470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 398/793] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:41:27 2022] GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:27.490177 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d5acc524-7efc-49c1-b609-fe344e44b949 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a83c99ca0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.538606 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d5acc524-7efc-49c1-b609-fe344e44b949 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 200 len: 353 microversion: 2.1 time: 0.052252 Jun 16 00:41:27.539475 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 396/794] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:41:27 2022] GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:27.555208 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3fb3d004-d533-42db-be9c-dfa833756c1a tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a7b37e5e0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.588492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.589120 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:27.598397 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.599140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.599605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:27.600046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:27.734310 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:27.742548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:27.744385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:27.745568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-aa96bfff-fc02-4775-a530-f182716e2667 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.160908 Jun 16 00:41:27.746117 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 397/795] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:27 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:27.786271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3fb3d004-d533-42db-be9c-dfa833756c1a tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 202 len: 0 microversion: 2.1 time: 0.232616 Jun 16 00:41:27.786271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 399/796] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:41:27 2022] DELETE /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:27.792891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e243aa94-0d43-4c22-a042-8309321d6736 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a83c968b0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:27.846219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e243aa94-0d43-4c22-a042-8309321d6736 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 200 len: 352 microversion: 2.1 time: 0.054936 Jun 16 00:41:27.846219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 398/797] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:41:27 2022] GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:41:28.763710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:28.764332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:28.771063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.771514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:28.772275 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:28.772770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:28.857125 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0057b192-da6b-4d42-bdde-eae21a705f66 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Calling method '.version_select at 0x7f2a83ca0430>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:28.886089 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-0057b192-da6b-4d42-bdde-eae21a705f66 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] HTTP exception thrown: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0057b192-da6b-4d42-bdde-eae21a705f66 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Request method failure captured: Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 HTTP/1.1 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnw1PBE7pku2KKREJvPchke4oj9gyXmc9Nu2jeEx1dlJ1p2WaioPh1t7FEVjMRTIwyF0QuXFZPxF9sxC_brtWgXcQWJx-B704OjthkYsk7AD2cCKe3I03arf3xQ0QUiGDkXOSSX_00jlvJVABKGfsmBmp_vWjGFW8FQNSsMo1-yhgOU Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 61d5e2a5218d47aa9a92ce3716790461 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-VolumesGetTestJSON-1653145625 Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:41:28.888198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d5e2a5218d47aa9a92ce3716790461"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_61d5e2a5218d47aa9a92ce3716790461"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/61d5e2a5218d47aa9a92ce3716790461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61d5e2a5218d47aa9a92ce3716790461"}]}] Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-VolumesGetTestJSON-1653145625 Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 61d5e2a5218d47aa9a92ce3716790461 Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-VolumesGetTestJSON-1653145625 Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-VolumesGetTestJSON-1653145625-project Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 02f1cd3cfa784328a0cf174040878e6c Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-VolumesGetTestJSON-1653145625-project Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'baed5454-cd5a-4a9e-9a02-e12c06ed8ff5'} Jun 16 00:41:28.889874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. (HTTP 404) (Request-ID: req-5b74d077-4c7a-4293-951d-ff05f78d9a21) Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:28.894056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 00:41:28.897752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 00:41:28.901338 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0057b192-da6b-4d42-bdde-eae21a705f66 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] Returning 404 to user: Volume baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0057b192-da6b-4d42-bdde-eae21a705f66 tempest-VolumesGetTestJSON-1653145625 tempest-VolumesGetTestJSON-1653145625-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5" status: 404 len: 109 microversion: 2.1 time: 0.036878 Jun 16 00:41:28.906845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 399/798] 10.222.0.20 () {58 vars in 1244 bytes} [Thu Jun 16 00:41:28 2022] GET /compute/v2.1/os-volumes/baed5454-cd5a-4a9e-9a02-e12c06ed8ff5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:41:28.915760 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:28.924922 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:28.926463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:28.927631 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f01263ad-020f-4d6d-8b43-08c20983852c tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.168492 Jun 16 00:41:28.928198 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 400/799] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:28 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:29.423470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-5af94810-2cc5-4cfd-834d-38a4e4f8363f req-3cfb9085-9d71-4017-9293-454f1ef589ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "name": "network-vif-plugged", "status": "completed", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:29.433679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-5af94810-2cc5-4cfd-834d-38a4e4f8363f req-3cfb9085-9d71-4017-9293-454f1ef589ff service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.434408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-5af94810-2cc5-4cfd-834d-38a4e4f8363f req-3cfb9085-9d71-4017-9293-454f1ef589ff service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.455650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-5af94810-2cc5-4cfd-834d-38a4e4f8363f req-3cfb9085-9d71-4017-9293-454f1ef589ff service nova] Creating event network-vif-plugged:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:41:29.463792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-5af94810-2cc5-4cfd-834d-38a4e4f8363f req-3cfb9085-9d71-4017-9293-454f1ef589ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046718 Jun 16 00:41:29.465021 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 400/800] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:41:29.947693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:29.948981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:29.956383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.956876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:29.957653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:29.958105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:30.104448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:30.112568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:30.114145 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:30.115310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-56b31704-8bd3-425b-86c8-8091d3e2acd4 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.172000 Jun 16 00:41:30.116221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 401/801] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:29 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 00:41:31.139377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:31.143483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:31.163731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:31.164184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:31.164977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:31.165411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:31.326989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:31.337135 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:31.338771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:31.339943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-64f309ad-7313-4ee5-96a9-dc5e55d42753 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.209007 Jun 16 00:41:31.341033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 401/802] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:31 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:32.359383 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:32.361414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:32.368027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.369567 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.370602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:32.371446 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:32.532566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:32.540512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:32.541960 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:32.543105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dc0e05d6-e59d-4d54-b4c7-fb3e39359292 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1730 microversion: 2.20 time: 0.187978 Jun 16 00:41:32.543754 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 402/803] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:32 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:33.561278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:33.561883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:33.568880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:33.573196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:33.573196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:33.573196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:33.590330 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:33.713241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:33.721553 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:33.723198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:33.724349 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4d6995fc-3090-4ac6-bcb4-9b8e2e13a036 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1717 microversion: 2.20 time: 0.166879 Jun 16 00:41:33.724937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 402/804] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:41:33 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1717 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:41:38.731652 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:41:38.732698 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:38.744591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:38.744591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:38.744591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:38.744591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:38.894692 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4e940b74-67c1-4bfa-938a-da625fd1219e tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action" status: 202 len: 0 microversion: 2.1 time: 0.166677 Jun 16 00:41:38.898636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 403/805] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:41:38 2022] POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:41:38.906272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:38.907731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:38.914751 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:38.915198 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:38.916025 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:38.916450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:39.103350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:39.112679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-62b2deb7-8ed0-4204-a268-9d5c439734c2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1752 microversion: 2.1 time: 0.210598 Jun 16 00:41:39.113554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 403/806] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:38 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:40.131125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:40.131817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:40.138070 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:40.138520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:40.139303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:40.139737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:40.289157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:40.297430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0edfce5b-ee22-4b39-9dd1-4752a55f932c tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.171021 Jun 16 00:41:40.297998 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 404/807] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:40 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:41.313917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:41.314559 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:41.322057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:41.322512 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:41.323272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:41.323711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:41.466146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:41.474808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5a99e749-9e16-4da6-91be-5b2041f28f8a tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.164686 Jun 16 00:41:41.475386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 404/808] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:41 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:42.491678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:42.492349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:42.498955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:42.499481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:42.500234 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:42.500741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:42.641835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:42.650198 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bc90b9e3-073a-40ea-ba0f-7b9ef5cca548 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.162385 Jun 16 00:41:42.650764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 405/809] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:42 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:43.667227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:43.667863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:43.674941 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:43.675387 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:43.676172 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:43.676637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:43.832880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:43.841725 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-85d43109-56e5-4a37-9782-d8f4b5e41909 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.178417 Jun 16 00:41:43.843312 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 405/810] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:43 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:44.860221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:44.860854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:44.867896 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:44.868333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:44.869260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:44.869647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:45.020915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:45.029601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7cca9873-eecc-4abd-8d9f-20366843ef44 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.173808 Jun 16 00:41:45.030178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 406/811] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:44 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:41:46.047140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:46.047926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:46.060363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:46.060363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:46.060363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:46.060363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:46.195952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:46.203910 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-677a22fc-4a77-450c-8f1f-914ccf9d3571 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.160672 Jun 16 00:41:46.204460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 406/812] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:46 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:47.220799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:47.221295 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:47.227959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:47.228415 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:47.229227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:47.229731 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:47.377659 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:47.386621 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-46db3988-237f-474f-b4c6-c1d61e3f0bba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.169845 Jun 16 00:41:47.387178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 407/813] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:47 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:48.404992 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:48.405686 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:48.412879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:48.413273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:48.414023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:48.414455 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:48.558171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:48.565972 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1a615707-0e51-4935-ad9d-c20176413d90 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.164868 Jun 16 00:41:48.566585 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 407/814] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:48 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:49.583146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:49.584408 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:49.593578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:49.594270 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:49.595721 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:49.596845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:49.757703 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:49.765808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9fcfaeac-83a5-43a3-9408-ace89ff6b945 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.186614 Jun 16 00:41:49.766368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 408/815] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:49 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:50.783992 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:50.784624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:50.786667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=30 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:50.791722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:50.792176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:50.792979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:50.793414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:50.948029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:50.955913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9eb31de9-f7d9-4430-96f2-876ce14c4a22 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.175886 Jun 16 00:41:50.958621 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 408/816] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:50 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:51.972709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:51.973309 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:51.975734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=28 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:51.980551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:51.980990 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:51.981759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:51.982190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:52.123969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:52.132647 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-282c4577-6f21-4bec-b91b-176492e48333 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.163805 Jun 16 00:41:52.133196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 409/817] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:51 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:53.149961 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:53.150583 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:53.157097 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:53.161114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:53.161114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:53.161114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:53.572476 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:53.580446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a382a003-cc77-4b48-88d1-364c3a8b4d08 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.434775 Jun 16 00:41:53.581031 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 409/818] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:53 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:54.598054 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:54.599401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:54.606377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:54.606841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:54.607748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:54.608181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:54.757164 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:54.765854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e6a075ca-9a4c-4ec6-b8bb-2e7841877154 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.172147 Jun 16 00:41:54.766991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 410/819] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:54 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:55.783077 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:55.786875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:55.791205 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:55.791875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:55.792825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:55.793462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:55.953371 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:55.964337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5ff69e11-6a17-4c9c-8ef2-d53239bcb282 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1757 microversion: 2.1 time: 0.184957 Jun 16 00:41:55.965202 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:55 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:41:56.981175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:41:56.981860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:41:56.988349 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:56.988905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:56.989680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:41:56.990119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:41:56.994060 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:57.138981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:41:57.147246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3ed63bc6-3508-4f56-8d60-ac35d20c57e2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1760 microversion: 2.1 time: 0.170067 Jun 16 00:41:57.147872 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 411/821] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:41:56 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:15.065275 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:15.066909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:15.070104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=5 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.071497 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=51 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.087457 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.087920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.089732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.089732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.126100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fa74dfc0-be7b-47d8-9379-627ddba5307e tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065441 Jun 16 00:42:15.126760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 411/822] 10.222.0.20 () {60 vars in 1342 bytes} [Thu Jun 16 00:42:15 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:15.202169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:15.202704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:15.206586 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=5 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:15.210391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.210836 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.211638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.212074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.239611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:42:15.619514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-eb544296-8e4d-4b0a-a6f7-9bf7bbd698b9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 204 len: 0 microversion: 2.20 time: 0.422131 Jun 16 00:42:15.622450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 412/823] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jun 16 00:42:15 2022] DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:42:15.631443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:15.632852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:15.643598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.644414 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:15.645565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:15.646341 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:16.197364 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:16.209462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:16.211456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:16.212752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-00994b3f-6baf-4ee1-9bec-99a0e8bf74ce tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.587157 Jun 16 00:42:16.213885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 412/824] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:15 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:42:17.231823 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:17.233189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:17.240681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:17.241354 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:17.242292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:17.242925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:17.436428 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:17.447491 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:17.450382 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:17.456598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fbe3fe50-087a-443c-b267-688922ecbce8 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1723 microversion: 2.20 time: 0.224891 Jun 16 00:42:17.456598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 413/825] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:17 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:42:18.171627 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-1a32da6a-8c84-4cee-a22f-d79e5b2ebdd9 req-e91c2540-ea10-45aa-8634-97f52af74c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d", "name": "network-vif-deleted", "tag": "3aed7710-78db-49be-89bf-f87f2e363d9b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:18.205971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-1a32da6a-8c84-4cee-a22f-d79e5b2ebdd9 req-e91c2540-ea10-45aa-8634-97f52af74c75 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.207550 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-1a32da6a-8c84-4cee-a22f-d79e5b2ebdd9 req-e91c2540-ea10-45aa-8634-97f52af74c75 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.244726 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-1a32da6a-8c84-4cee-a22f-d79e5b2ebdd9 req-e91c2540-ea10-45aa-8634-97f52af74c75 service nova] Creating event network-vif-deleted:3aed7710-78db-49be-89bf-f87f2e363d9b for instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d on hv-cinder-80382 Jun 16 00:42:18.254838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-1a32da6a-8c84-4cee-a22f-d79e5b2ebdd9 req-e91c2540-ea10-45aa-8634-97f52af74c75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095442 Jun 16 00:42:18.255681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 413/826] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:18.472573 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:18.474343 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:18.482816 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.483271 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.484246 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:18.484986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:18.569488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:18.580545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:18.592006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31973e5a04c14cfc90ab377eac5f4194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494ce289f1774df0833301de8e46ae11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:18.596090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ca33e41a-1921-4383-a64b-adcc4b7556e9 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 200 len: 1366 microversion: 2.20 time: 0.129640 Jun 16 00:42:18.597238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 414/827] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:18 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 00:42:19.622445 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:19.625637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:19.637422 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:19.637927 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:19.639415 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:19.639949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:19.662495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d HTTP/1.1 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:42:19.677815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:19.679284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d'} Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:19.680088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:19.681446 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:19.683056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:19.683056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b11a12b9-64d1-45e5-82d6-21385ae5ae70 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 404 len: 111 microversion: 2.20 time: 0.066964 Jun 16 00:42:19.684891 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 414/828] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:19 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:42:19.690000 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-38fc8169-b2f9-46a9-a76a-e83f5a80da31 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '.version_select at 0x7f2a7b34e4c0>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:19.817171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-38fc8169-b2f9-46a9-a76a-e83f5a80da31 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821654007" status: 204 len: 0 microversion: 2.20 time: 0.130872 Jun 16 00:42:19.820885 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 415/829] 10.222.0.20 () {60 vars in 1261 bytes} [Thu Jun 16 00:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821654007 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 00:42:22.246350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:22.246350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:22.251650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:22.252040 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:22.252831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:22.253259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:22.283226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d HTTP/1.1 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:42:22.287960 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.289807 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d'} Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:22.290688 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.292002 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.293840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:22.293840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-297cba81-ac52-4e3d-ba56-4bc331e0375b tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 404 len: 111 microversion: 2.20 time: 0.048468 Jun 16 00:42:22.299108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 415/830] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jun 16 00:42:22 2022] DELETE /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:42:22.299471 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:22.301492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:22.320079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:22.320940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:22.322051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:22.322498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:22.345449 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d HTTP/1.1 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:42:22.347758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.349237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d'} Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:22.350004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. Jun 16 00:42:22.351273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:22.352361 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:22.352361 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6c8e2552-6058-484a-baba-d37b548514db tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d" status: 404 len: 111 microversion: 2.20 time: 0.057379 Jun 16 00:42:22.352361 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 416/831] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:22 2022] GET /compute/v2.1/servers/42b1e6aa-2dcb-4e03-bdb7-c60b1b77ea4d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:42:23.705339 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:23.705985 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:23.708245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-be1777f1-8a04-431a-badd-c92c251ac5d2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Action: 'create', calling method: .version_select at 0x7f2a7b3c3940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-530055099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8um1yK1Rp59DzG6cST3nkKVX23pb9C5goVjwPD1hc4TqpenJmRFbDp7zSdr9MUSTLfUZv2RtoFv4oW3lgnuz6SH3hbmOvQOmIctIToACvK9LNix5naXM6w/gyT16dkCw=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:23.713059 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:23.713723 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:23.715203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:23.715712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:23.724853 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-be1777f1-8a04-431a-badd-c92c251ac5d2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:42:23.728918 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-be1777f1-8a04-431a-badd-c92c251ac5d2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for user 517928d85b764c089c6dd5b2d088639c and project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:42:23.730250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 HTTP/1.1 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:42:23.731806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.733294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '787e855e-1684-4ea2-aeeb-6e5737f35194'} Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:23.734056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.735868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.738166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:23.738166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d74bba63-28f9-44fc-ad1b-3fcc7bc2737a tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 404 len: 111 microversion: 2.20 time: 0.032229 Jun 16 00:42:23.738166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 417/832] 10.222.0.20 () {60 vars in 1279 bytes} [Thu Jun 16 00:42:23 2022] DELETE /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 00:42:23.741885 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:23.742511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] [instance: 787e855e-1684-4ea2-aeeb-6e5737f35194] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:23.749168 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:23.749629 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:23.750409 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:23.750842 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:23.766274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] HTTP exception thrown: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Request method failure captured: Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 HTTP/1.1 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnqqWyuldtgZmf05gwv5kgS_Mo5D-1V0orTrs3rwu7rOgG3l21kutm4k3LUBVyKVybZJftb7_RmbH4g6iteKUBOCkBPnQbunsFriqKzj5tj-TWO4mFpEQ2oHrz-3GU1m96Pn52_mfs3eyO0vV2BsHl91X3Uwqw6Ioau1_1jBzRC4BiQ Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:42:23.767839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_494ce289f1774df0833301de8e46ae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/494ce289f1774df0833301de8e46ae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/494ce289f1774df0833301de8e46ae11"}]}] Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 494ce289f1774df0833301de8e46ae11 Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1206453575 Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 31973e5a04c14cfc90ab377eac5f4194 Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1206453575-project Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.772504 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '787e855e-1684-4ea2-aeeb-6e5737f35194'} Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:23.773427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. Jun 16 00:42:23.774821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:23.776870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] Returning 404 to user: Instance 787e855e-1684-4ea2-aeeb-6e5737f35194 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:23.776870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d8d3c5b6-6f27-47c2-91b7-51ab0fac5629 tempest-AttachVolumeShelveTestJSON-1206453575 tempest-AttachVolumeShelveTestJSON-1206453575-project] 10.222.0.20 "GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194" status: 404 len: 111 microversion: 2.20 time: 0.031200 Jun 16 00:42:23.776870 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 418/833] 10.222.0.20 () {60 vars in 1276 bytes} [Thu Jun 16 00:42:23 2022] GET /compute/v2.1/servers/787e855e-1684-4ea2-aeeb-6e5737f35194 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 00:42:23.832334 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-be1777f1-8a04-431a-badd-c92c251ac5d2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.338327 Jun 16 00:42:23.833109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 416/834] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:42:23 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:36.080418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:36.081221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:36.205453 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-93d739b1-74e8-463a-aa2d-a6116883b736 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: .version_select at 0x7f2a7b3b2dc0>, body: {"keypair": {"name": "tempest-keypair-363522292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5PV+Amzjd0VkNcllr0zViqS3TTti9rjDXBTuPP5rWzqayCf7NYdNZsyeAmsk9q3yZ+ZvKiZwz0qTLeDTHhTMOWZtwdB4UcRP8RVnPYmVaObh20bMvQCjbssWzlUmOH5g=="}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:36.222540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-93d739b1-74e8-463a-aa2d-a6116883b736 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:42:36.226544 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-93d739b1-74e8-463a-aa2d-a6116883b736 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for user b3e4c68725cb4a9ea9024c3205dd5588 and project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:42:36.306352 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-93d739b1-74e8-463a-aa2d-a6116883b736 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.230865 Jun 16 00:42:36.306951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 419/835] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:42:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:36.372575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=18 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:36.373355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:36.374016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:36.378105 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-999590129"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:36.378644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:36.386716 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:36.387483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:36.388660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:36.389106 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:36.548286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.network.security_group_api [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Removing security group 384e488b-4692-4e93-90f7-79fad658ae61 from port 6a0788b7-0528-40f3-80fe-df58bcfaf509 Jun 16 00:42:36.982547 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-97260e29-f741-45fc-b066-f4c17f9c63b0 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action" status: 202 len: 0 microversion: 2.1 time: 0.611744 Jun 16 00:42:36.989829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 417/836] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:42:36 2022] POST /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:42:36.996759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-f5522d5f-0326-46d2-9c56-7b0c429f765c req-180e93e8-523e-4bac-8fe3-c3a5e218485f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:37.013936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-f5522d5f-0326-46d2-9c56-7b0c429f765c req-180e93e8-523e-4bac-8fe3-c3a5e218485f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:37.014764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-f5522d5f-0326-46d2-9c56-7b0c429f765c req-180e93e8-523e-4bac-8fe3-c3a5e218485f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:37.035984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-f5522d5f-0326-46d2-9c56-7b0c429f765c req-180e93e8-523e-4bac-8fe3-c3a5e218485f service nova] Creating event network-changed:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:42:37.043360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-f5522d5f-0326-46d2-9c56-7b0c429f765c req-180e93e8-523e-4bac-8fe3-c3a5e218485f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054890 Jun 16 00:42:37.043360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 420/837] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:38.622262 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:38.622753 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:38.634321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-1409e040-b378-420f-a1bd-f866e827fd7a req-0a58ebbb-2ed1-4895-ac4f-5ad0f80c64e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:38.636972 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:38.637604 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:38.638413 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:38.638851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:38.651335 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-1409e040-b378-420f-a1bd-f866e827fd7a req-0a58ebbb-2ed1-4895-ac4f-5ad0f80c64e8 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:38.653986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-1409e040-b378-420f-a1bd-f866e827fd7a req-0a58ebbb-2ed1-4895-ac4f-5ad0f80c64e8 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:38.674412 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-1409e040-b378-420f-a1bd-f866e827fd7a req-0a58ebbb-2ed1-4895-ac4f-5ad0f80c64e8 service nova] Creating event network-changed:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:42:38.689098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-1409e040-b378-420f-a1bd-f866e827fd7a req-0a58ebbb-2ed1-4895-ac4f-5ad0f80c64e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059026 Jun 16 00:42:38.690298 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 421/838] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:42:38.755787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lazy-loading 'services' on Instance uuid 63ba2bcd-076b-43b8-8753-fb86693d2614 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:42:39.030764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cf9d83f3-d20b-49a8-bb65-c54b949bd512 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments/3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3" status: 202 len: 0 microversion: 2.1 time: 0.412743 Jun 16 00:42:39.031459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:42:38 2022] DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments/3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:42:39.044892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:39.051653 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:39.059281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:39.059784 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:39.060763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:39.061207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:39.097372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-17ce1618-8179-44cd-80e4-c8b0b0b77241 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061335 Jun 16 00:42:39.098570 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 422/840] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:42:39 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:39.579822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2001060014", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4929321f-89e1-434e-a080-491c8ce8d5b1"}], "security_groups": [{"name": "tempest-securitygroup--2038549254"}], "key_name": "tempest-keypair-363522292", "user_data": "}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:39.815541 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] validate_networks() for [('4929321f-89e1-434e-a080-491c8ce8d5b1', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:42:40.110394 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:40.111439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:40.118752 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:40.120296 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:40.121717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:40.122460 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:40.160181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-153c44a4-c45b-4108-8ca6-21f64f99ddfd tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053908 Jun 16 00:42:40.161500 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 423/841] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:42:40 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:42:40.307482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:42:40.309637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:42:40.309637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:42:40.309637 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:42:40.310095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:42:40.319800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:40.320254 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:40.321775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:40.322380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:40.339965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:42:40.344707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for user b3e4c68725cb4a9ea9024c3205dd5588 and project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:42:40.359071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:42:40.361450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:42:40.532466 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9d551b89-b6d2-40fd-864b-72cc2a0b141c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.959684 Jun 16 00:42:40.533138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 419/842] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:42:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:42:40.543192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-03595187-c5e4-4829-8f30-69726a621d36 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:40.543808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-03595187-c5e4-4829-8f30-69726a621d36 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:40.602074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03595187-c5e4-4829-8f30-69726a621d36 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:40.609604 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-03595187-c5e4-4829-8f30-69726a621d36 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1237 microversion: 2.1 time: 0.070315 Jun 16 00:42:40.610552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 424/843] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:40 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:41.172332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:41.173344 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:41.180443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:41.180920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:41.181685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:41.182369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:41.210168 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4c122f4e-0aa9-4427-9b02-da1334f07ef2 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042747 Jun 16 00:42:41.210772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 420/844] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:42:41 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:42:41.220557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:41.221080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:41.228625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:41.229073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:41.229836 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:41.230270 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:41.308056 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] HTTP exception thrown: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 is not attached to volume 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Request method failure captured: Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments/3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 HTTP/1.1 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnvwMjed5UW1kdoW2yE65Z3-o9rxJBgmXfBnwSdPr6vm3M27otKbqM_LwdzOpcU730V6ArEJrPyglWer1J7hWk5L57VmVuFj9vzQKvOz-05HzjBBc0gsOADIbSokrXgpbLm_VZu6azZ1u9LWy_3Opxcnz5TmJfZ2k3qLLANz6y83wWE Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: ad47d922a30a4c55a781c52c5bd5236f Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:42:41.310511 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad47d922a30a4c55a781c52c5bd5236f"}]}] Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: ad47d922a30a4c55a781c52c5bd5236f Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-TestMinimumBasicScenario-410999148-project Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: f2aa1b8204b1494589e096ad775ce4d9 Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-TestMinimumBasicScenario-410999148-project Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:42:41.312125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 is not attached to volume 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'server_id': '63ba2bcd-076b-43b8-8753-fb86693d2614', 'id': '3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3'} Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3. Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:41.312996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 is not attached to volume 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 is not attached to volume 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:42:41.314398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Returning 404 to user: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 is not attached to volume 3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:41.315512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-15358a5e-e430-4191-b627-046d12b89331 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments/3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3" status: 404 len: 154 microversion: 2.1 time: 0.095437 Jun 16 00:42:41.315512 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 425/845] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:42:41 2022] DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614/os-volume_attachments/3cf0e87c-108d-46c0-bbd2-0b25a8a71fc3 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:42:41.626485 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b8434868-1a62-4683-80fc-c7d5e6efa63a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:41.627095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b8434868-1a62-4683-80fc-c7d5e6efa63a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:41.680552 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b8434868-1a62-4683-80fc-c7d5e6efa63a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:41.687204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b8434868-1a62-4683-80fc-c7d5e6efa63a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1237 microversion: 2.1 time: 0.064671 Jun 16 00:42:41.687759 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 421/846] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:41 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:42.692290 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:42.692796 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:42.699442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:42.699888 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:42.701203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:42.701643 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:42.703668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:42.704280 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:42.712443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:42.712919 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:42.713741 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:42.714178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:42.729053 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:42:42.775812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:42.783146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-197107bc-55b2-454e-ab01-b491400c3068 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1289 microversion: 2.1 time: 0.084119 Jun 16 00:42:42.786790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 422/847] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:42 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:43.033312 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5e9c7c3c-dc43-4705-81da-238f28d3e4ba tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 204 len: 0 microversion: 2.1 time: 0.344512 Jun 16 00:42:43.034185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 426/848] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:42:42 2022] DELETE /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:42:43.042474 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:43.043085 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:43.049175 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:43.049623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:43.050443 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:43.050880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:43.180611 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:43.188745 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-81ff6b43-ff52-44ce-a74f-37a2e9a4e337 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1555 microversion: 2.1 time: 0.150288 Jun 16 00:42:43.189316 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 423/849] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:43 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:43.801058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:43.801781 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:43.808144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:43.808621 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:43.809410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:43.809844 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:43.870804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:43.878113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-95276438-30b5-4306-9f9f-2ff534566604 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1307 microversion: 2.1 time: 0.081309 Jun 16 00:42:43.878661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 427/850] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:43 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1307 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:44.117245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1685254296", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530055099", "security_groups": [{"name": "tempest-secgroup-smoke-298912126"}], "block_device_mapping_v2": [{"uuid": "3b037b59-d9dd-479e-87d1-96d99a9c0914", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "edd9d18b-1d6c-4052-b07a-8baf4adc8bec"}]}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:44.206474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:44.207085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:44.212958 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.213410 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.214178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.214615 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.226148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] validate_networks() for [('edd9d18b-1d6c-4052-b07a-8baf4adc8bec', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:42:44.343115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:44.350715 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-25256e41-615e-493a-917a-22486687e828 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1555 microversion: 2.1 time: 0.148104 Jun 16 00:42:44.351284 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 428/851] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:44 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:44.675498 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:42:44.676092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:42:44.676795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:42:44.677253 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:42:44.677794 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:42:44.688224 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.689026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.689903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.690598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.707034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:42:44.710947 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for user 517928d85b764c089c6dd5b2d088639c and project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:42:44.771244 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:42:44.773302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b037b59-d9dd-479e-87d1-96d99a9c0914',volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:42:44.895417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:44.896048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:44.904612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.905063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.905834 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:44.906270 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:44.975321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:44.983294 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-da988da0-ba98-43c3-b43c-5dd7ef9ecade tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1295 microversion: 2.1 time: 0.091805 Jun 16 00:42:44.984113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 429/852] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:44 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:45.203858 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4e15ed36-0a1d-4658-9107-26c6bbf173ab tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090393 Jun 16 00:42:45.209813 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 424/853] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:42:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:42:45.217602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a0f446ff-47c4-4514-a367-413c1d421b0c tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:45.218445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a0f446ff-47c4-4514-a367-413c1d421b0c tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:45.279580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a0f446ff-47c4-4514-a367-413c1d421b0c tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:45.286039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a0f446ff-47c4-4514-a367-413c1d421b0c tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1094 microversion: 2.1 time: 0.073063 Jun 16 00:42:45.295287 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 430/854] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:45 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:45.367654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:45.368455 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:45.376000 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:45.376462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:45.377317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:45.377762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:45.858681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:45.866238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8d109d4e-0d6a-42ba-b9d1-714b4b2c8734 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1555 microversion: 2.1 time: 0.502591 Jun 16 00:42:45.866804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 425/855] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:45 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1555 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:46.001204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:46.002083 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:46.010034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.011191 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.012080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.012657 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.049589 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-ea3a2e37-d9ce-44d0-8138-c8816c0b2d9c req-13ea17e1-e961-4fa3-8419-95e1c1938b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba2bcd-076b-43b8-8753-fb86693d2614", "name": "network-vif-deleted", "tag": "6a0788b7-0528-40f3-80fe-df58bcfaf509"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:46.059410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-ea3a2e37-d9ce-44d0-8138-c8816c0b2d9c req-13ea17e1-e961-4fa3-8419-95e1c1938b26 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.060126 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-ea3a2e37-d9ce-44d0-8138-c8816c0b2d9c req-13ea17e1-e961-4fa3-8419-95e1c1938b26 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.072082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-ea3a2e37-d9ce-44d0-8138-c8816c0b2d9c req-13ea17e1-e961-4fa3-8419-95e1c1938b26 service nova] Creating event network-vif-deleted:6a0788b7-0528-40f3-80fe-df58bcfaf509 for instance 63ba2bcd-076b-43b8-8753-fb86693d2614 on hv-cinder-80382 Jun 16 00:42:46.077452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-ea3a2e37-d9ce-44d0-8138-c8816c0b2d9c req-13ea17e1-e961-4fa3-8419-95e1c1938b26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031505 Jun 16 00:42:46.078189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 426/856] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:46.149593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:46.157904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e850ca80-dd50-4326-a667-2c4f09880601 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.161116 Jun 16 00:42:46.158466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 431/857] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:45 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:46.303715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:46.304416 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:46.312452 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.313483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.314454 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.315489 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.398427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:46.407345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cf75d867-5368-407e-88c1-6b9ac2a1ff6e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1144 microversion: 2.1 time: 0.107873 Jun 16 00:42:46.407915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 427/858] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:46 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:46.882299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:46.882920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:46.890003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.890455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.891228 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.891666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.924671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:46.925128 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:46.925588 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lazy-loading 'fault' on Instance uuid 63ba2bcd-076b-43b8-8753-fb86693d2614 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:42:46.967123 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2aa1b8204b1494589e096ad775ce4d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad47d922a30a4c55a781c52c5bd5236f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:46.974642 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3022a80f-1be8-41e0-8873-97e376f3144f tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 200 len: 1348 microversion: 2.1 time: 0.096249 Jun 16 00:42:46.975202 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 432/859] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:46 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:47.175532 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:47.176554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:47.182678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:47.183133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:47.184074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:47.184749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:47.387139 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:47.394749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-10b6c62a-cd93-4479-baca-71821cb1d970 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.223265 Jun 16 00:42:47.395386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 428/860] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:47 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:47.424250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:47.424965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:47.432737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:47.433301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:47.434113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:47.434747 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:47.507263 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:47.516625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a2d9045d-3852-4826-999c-2280f9f1a420 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1192 microversion: 2.1 time: 0.097247 Jun 16 00:42:47.517200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 433/861] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:47 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:47.991353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:47.991994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] [instance: 63ba2bcd-076b-43b8-8753-fb86693d2614] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:47.998568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:47.999055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:47.999822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.000261 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.014406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] HTTP exception thrown: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Request method failure captured: Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 HTTP/1.1 Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnvwMjed5UW1kdoW2yE65Z3-o9rxJBgmXfBnwSdPr6vm3M27otKbqM_LwdzOpcU730V6ArEJrPyglWer1J7hWk5L57VmVuFj9vzQKvOz-05HzjBBc0gsOADIbSokrXgpbLm_VZu6azZ1u9LWy_3Opxcnz5TmJfZ2k3qLLANz6y83wWE Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: ad47d922a30a4c55a781c52c5bd5236f Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:42:48.016023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad47d922a30a4c55a781c52c5bd5236f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad47d922a30a4c55a781c52c5bd5236f"}]}] Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: ad47d922a30a4c55a781c52c5bd5236f Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-TestMinimumBasicScenario-410999148 Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-TestMinimumBasicScenario-410999148-project Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: f2aa1b8204b1494589e096ad775ce4d9 Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-TestMinimumBasicScenario-410999148-project Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. Jun 16 00:42:48.017630 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '63ba2bcd-076b-43b8-8753-fb86693d2614'} Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:42:48.018540 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. Jun 16 00:42:48.020070 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:42:48.021469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Returning 404 to user: Instance 63ba2bcd-076b-43b8-8753-fb86693d2614 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:42:48.021469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a6e2e589-4557-4123-9172-98893dec3e04 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jun 16 00:42:48.021469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 429/862] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:47 2022] GET /compute/v2.1/servers/63ba2bcd-076b-43b8-8753-fb86693d2614 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:42:48.026401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5b9c24db-2748-46b0-855b-be2d2de97638 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] Calling method '.version_select at 0x7f2a7b465d30>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:48.097528 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-4023783b-5df0-4b05-80e5-b6980bbc2f55 req-fcbcdb0a-8265-4472-ad9b-a284661f11ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d495c1-980b-4b00-8770-6f4be830077b", "tag": "69e9c668-803b-42f4-8d52-2232717ce29c"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:48.105592 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4023783b-5df0-4b05-80e5-b6980bbc2f55 req-fcbcdb0a-8265-4472-ad9b-a284661f11ea service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.106041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4023783b-5df0-4b05-80e5-b6980bbc2f55 req-fcbcdb0a-8265-4472-ad9b-a284661f11ea service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.113563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5b9c24db-2748-46b0-855b-be2d2de97638 tempest-TestMinimumBasicScenario-410999148 tempest-TestMinimumBasicScenario-410999148-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728561768" status: 202 len: 0 microversion: 2.1 time: 0.090880 Jun 16 00:42:48.114172 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 434/863] 10.222.0.20 () {58 vars in 1268 bytes} [Thu Jun 16 00:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-728561768 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:42:48.117636 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-4023783b-5df0-4b05-80e5-b6980bbc2f55 req-fcbcdb0a-8265-4472-ad9b-a284661f11ea service nova] Creating event network-changed:69e9c668-803b-42f4-8d52-2232717ce29c for instance d6d495c1-980b-4b00-8770-6f4be830077b on hv-cinder-80382 Jun 16 00:42:48.122914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-4023783b-5df0-4b05-80e5-b6980bbc2f55 req-fcbcdb0a-8265-4472-ad9b-a284661f11ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028459 Jun 16 00:42:48.128834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 430/864] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:42:48.412935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:48.413667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:48.420279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.420883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.421645 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.422084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.534642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:48.535337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:48.541502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.541956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.542715 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:48.543151 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:48.557024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:48.565740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cc6218d5-f886-4e14-99a7-703914ffbc8b tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.157105 Jun 16 00:42:48.566303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 435/865] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:48 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:48.614506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:48.626943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5fc9023a-d960-4fa4-82e9-60a49e220791 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1200 microversion: 2.1 time: 0.096616 Jun 16 00:42:48.627827 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 431/866] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:48 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:49.583830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:49.584552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:49.591426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:49.592178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:49.593332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:49.593962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:49.647014 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:49.647625 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:49.656054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:49.656439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:49.657272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:49.657713 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:49.725761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:49.733247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f3b42213-5992-436e-9377-a3df0084faad tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1210 microversion: 2.1 time: 0.090168 Jun 16 00:42:49.733815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 432/867] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:49 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:50.092234 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:50.101353 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c2878b7e-f01b-4e12-a308-c56b0fbc2d55 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.521975 Jun 16 00:42:50.101929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 436/868] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:49 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:50.752226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:50.752977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:50.761760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:50.762162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:50.763695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:50.764286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:50.915219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:50.923176 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6bbabb0b-2f7d-4f79-99a5-5d33a98d8e87 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.175915 Jun 16 00:42:50.923742 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 433/869] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:50 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:51.050423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-0f9c7d35-d4d4-40d7-a62c-89a14687b108 req-e9b381f2-4044-4951-8e61-128f2a88f3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cfd9b5-deae-43b6-a743-de414f1ed662", "tag": "d5fb2be2-9506-4ad0-9b2c-6c4b7429291b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:51.058679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0f9c7d35-d4d4-40d7-a62c-89a14687b108 req-e9b381f2-4044-4951-8e61-128f2a88f3d7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.059396 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0f9c7d35-d4d4-40d7-a62c-89a14687b108 req-e9b381f2-4044-4951-8e61-128f2a88f3d7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:51.082030 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-0f9c7d35-d4d4-40d7-a62c-89a14687b108 req-e9b381f2-4044-4951-8e61-128f2a88f3d7 service nova] Creating event network-changed:d5fb2be2-9506-4ad0-9b2c-6c4b7429291b for instance b9cfd9b5-deae-43b6-a743-de414f1ed662 on hv-cinder-80382 Jun 16 00:42:51.087353 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-0f9c7d35-d4d4-40d7-a62c-89a14687b108 req-e9b381f2-4044-4951-8e61-128f2a88f3d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047621 Jun 16 00:42:51.088371 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 437/870] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:51.119544 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:51.120168 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:51.128341 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.128831 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:51.129694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.130143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:51.422478 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:51.427968 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-7a98e38f-cb87-40aa-8938-3fc8d57aec8b req-821e9639-b1bc-48fe-8c77-9f0860b37e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d495c1-980b-4b00-8770-6f4be830077b", "name": "network-vif-plugged", "status": "completed", "tag": "69e9c668-803b-42f4-8d52-2232717ce29c"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:51.431213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9d8bcfbb-c5dd-4c78-ac83-32f05ec4838e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.316188 Jun 16 00:42:51.439541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7a98e38f-cb87-40aa-8938-3fc8d57aec8b req-821e9639-b1bc-48fe-8c77-9f0860b37e5e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.441834 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 434/871] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:51 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:51.449161 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7a98e38f-cb87-40aa-8938-3fc8d57aec8b req-821e9639-b1bc-48fe-8c77-9f0860b37e5e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:51.455766 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-7a98e38f-cb87-40aa-8938-3fc8d57aec8b req-821e9639-b1bc-48fe-8c77-9f0860b37e5e service nova] Creating event network-vif-plugged:69e9c668-803b-42f4-8d52-2232717ce29c for instance d6d495c1-980b-4b00-8770-6f4be830077b on hv-cinder-80382 Jun 16 00:42:51.460607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-7a98e38f-cb87-40aa-8938-3fc8d57aec8b req-821e9639-b1bc-48fe-8c77-9f0860b37e5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037204 Jun 16 00:42:51.461476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 438/872] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:42:51.939707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:51.940322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:51.948714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.949192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:51.949989 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:51.950461 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:52.099058 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:52.107883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-927b56cf-d633-4f75-8f21-5d4096d1e04d tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.172507 Jun 16 00:42:52.108584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 435/873] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:51 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:42:52.449779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:52.451157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:52.457457 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:52.457914 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:52.458771 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:52.459219 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:52.659137 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:52.666659 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-77471d5c-31bf-40b9-93e3-627da46dcbd3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1363 microversion: 2.1 time: 0.222141 Jun 16 00:42:52.667303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 439/874] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:52 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:53.125213 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:53.126258 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:53.136369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.136852 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.138605 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.139100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.376449 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:53.384879 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ef16859d-91db-4574-b7c5-417707211fff tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.263872 Jun 16 00:42:53.385684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 436/875] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:53 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:53.683139 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:53.684611 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:53.693303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.693762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.695368 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.696204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.700644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:53.829301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:53.833804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8f6aa291-9424-42c7-8c30-f6de4772e8ed tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1550 microversion: 2.1 time: 0.154509 Jun 16 00:42:53.836091 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 440/876] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:53 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:53.850614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:53.851108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:53.857848 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.858302 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.859059 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:53.859500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:53.876730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:53.944189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9b5f765e-10f6-447c-9529-d1533182a969 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097512 Jun 16 00:42:53.945036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 437/877] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:42:53 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:54.402925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:54.408563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:54.411881 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:54.412334 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:54.413138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:54.413753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:54.641612 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:54.650935 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d8438dd4-c684-432e-870c-b6e649db3e33 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.252264 Jun 16 00:42:54.652569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 441/878] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:54 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:55.210917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:55.211742 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=14 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:55.215969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-f3414e7c-b64c-4478-a46e-a24fdbfc4c43 req-f0191681-b041-49a2-ba36-53c9fa8ab29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d495c1-980b-4b00-8770-6f4be830077b", "tag": "69e9c668-803b-42f4-8d52-2232717ce29c"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:42:55.225145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-f3414e7c-b64c-4478-a46e-a24fdbfc4c43 req-f0191681-b041-49a2-ba36-53c9fa8ab29e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:55.225829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-f3414e7c-b64c-4478-a46e-a24fdbfc4c43 req-f0191681-b041-49a2-ba36-53c9fa8ab29e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:55.238935 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-f3414e7c-b64c-4478-a46e-a24fdbfc4c43 req-f0191681-b041-49a2-ba36-53c9fa8ab29e service nova] Creating event network-changed:69e9c668-803b-42f4-8d52-2232717ce29c for instance d6d495c1-980b-4b00-8770-6f4be830077b on hv-cinder-80382 Jun 16 00:42:55.246187 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-f3414e7c-b64c-4478-a46e-a24fdbfc4c43 req-f0191681-b041-49a2-ba36-53c9fa8ab29e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Jun 16 00:42:55.246979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 438/879] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:42:55.669925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:55.670690 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:55.672987 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=8 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:55.680555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:55.681014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:55.681808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:55.682250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:55.894344 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:55.902313 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ef8145e7-b5e9-487e-a986-eb4538b8e5ba tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.236775 Jun 16 00:42:55.912130 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 442/880] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:55 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:56.926777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:56.927500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:56.936537 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:56.936994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:56.937791 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:56.939138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:57.161871 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:57.170895 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-033f940d-ad43-44e9-8a8b-32bbf4d52471 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.252858 Jun 16 00:42:57.173266 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 439/881] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:56 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:58.188687 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:58.189212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:58.195718 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:58.196443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:58.197241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:58.197686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:58.339159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:58.347282 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b9b7dd64-c1fe-4ca5-8d30-20d474777099 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.162642 Jun 16 00:42:58.348007 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 443/882] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:58 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:42:59.365098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:42:59.365738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:42:59.372098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:59.372587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:59.373341 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:42:59.374308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:42:59.506189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:42:59.514038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-64978af5-f50a-4317-a2d5-a3665465b3b0 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.152730 Jun 16 00:42:59.515467 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 440/883] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:42:59 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:00.531603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:00.532200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:00.538209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:00.538658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:00.539438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:00.539876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:00.666482 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:00.673926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-61fe666b-c559-47c3-9868-a7670b1cf527 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.146952 Jun 16 00:43:00.674478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 444/884] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:00 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:43:01.690555 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:01.691160 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:01.697962 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:01.698389 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:01.699148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:01.699584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:01.831562 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:01.838919 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b6ea3954-d2de-4cfd-95ee-bc01cbb1103f tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.152217 Jun 16 00:43:01.839483 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 441/885] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:01 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:02.855405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:02.856020 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:02.862591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:02.863047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:02.863814 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:02.864255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:02.990316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:02.997707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-45577270-f81f-4017-a9d3-d489a4a6ded9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.146140 Jun 16 00:43:02.998265 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 445/886] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:02 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:03.347804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-4c9db8bb-4ec1-4f41-b972-58ee89db0291 req-b13bc9d4-385d-4250-9bf6-76595d52ef4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cfd9b5-deae-43b6-a743-de414f1ed662", "name": "network-vif-plugged", "status": "completed", "tag": "d5fb2be2-9506-4ad0-9b2c-6c4b7429291b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:03.356024 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4c9db8bb-4ec1-4f41-b972-58ee89db0291 req-b13bc9d4-385d-4250-9bf6-76595d52ef4f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:03.356469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4c9db8bb-4ec1-4f41-b972-58ee89db0291 req-b13bc9d4-385d-4250-9bf6-76595d52ef4f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:03.367956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-4c9db8bb-4ec1-4f41-b972-58ee89db0291 req-b13bc9d4-385d-4250-9bf6-76595d52ef4f service nova] Creating event network-vif-plugged:d5fb2be2-9506-4ad0-9b2c-6c4b7429291b for instance b9cfd9b5-deae-43b6-a743-de414f1ed662 on hv-cinder-80382 Jun 16 00:43:03.372932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-4c9db8bb-4ec1-4f41-b972-58ee89db0291 req-b13bc9d4-385d-4250-9bf6-76595d52ef4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028753 Jun 16 00:43:03.373696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 442/887] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:04.014557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:04.015188 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:04.021593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:04.022091 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:04.022806 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:04.023240 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:04.355074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:04.362438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e04bdda7-239c-4625-af9a-17ea964817a3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.351720 Jun 16 00:43:04.362996 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 446/888] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:04 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:05.380026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:05.380742 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:05.386897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:05.387326 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:05.388073 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:05.388501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:05.522573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:05.530683 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-db30bc4f-69a7-4918-bf08-079cb1a06f71 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1265 microversion: 2.1 time: 0.154831 Jun 16 00:43:05.531247 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 443/889] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:05 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:06.547308 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:06.547920 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:06.550360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:06.555135 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:06.555591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:06.556359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:06.556824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:06.685302 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:06.692640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bfcde77a-5673-4e0a-b6d3-826187b3b9a8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1453 microversion: 2.1 time: 0.149156 Jun 16 00:43:06.693203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 447/890] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:06 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:06.709250 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:06.709863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:06.716131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:06.716615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:06.717366 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:06.718360 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:06.852033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:06.859495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b0594988-f677-423a-acb6-0615efe41ddb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1453 microversion: 2.1 time: 0.154051 Jun 16 00:43:06.860051 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 444/891] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:06 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:09.173424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-fc3bb8b3-aa89-4f13-a4e3-fb3b909b3ff2 req-243745ec-27d7-4917-b7ea-7c817cccfb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cfd9b5-deae-43b6-a743-de414f1ed662", "tag": "d5fb2be2-9506-4ad0-9b2c-6c4b7429291b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:09.181991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-fc3bb8b3-aa89-4f13-a4e3-fb3b909b3ff2 req-243745ec-27d7-4917-b7ea-7c817cccfb40 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:09.182520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-fc3bb8b3-aa89-4f13-a4e3-fb3b909b3ff2 req-243745ec-27d7-4917-b7ea-7c817cccfb40 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:09.193258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-fc3bb8b3-aa89-4f13-a4e3-fb3b909b3ff2 req-243745ec-27d7-4917-b7ea-7c817cccfb40 service nova] Creating event network-changed:d5fb2be2-9506-4ad0-9b2c-6c4b7429291b for instance b9cfd9b5-deae-43b6-a743-de414f1ed662 on hv-cinder-80382 Jun 16 00:43:09.198850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-fc3bb8b3-aa89-4f13-a4e3-fb3b909b3ff2 req-243745ec-27d7-4917-b7ea-7c817cccfb40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029783 Jun 16 00:43:09.199779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 448/892] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:11.190303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:43:11.190992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:43:30.484137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:30.484762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:30.486743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:30.487399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=34 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:30.492035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:30.493071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:30.493345 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:30.493749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:30.515942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a94146b5-87ea-4352-af25-6ee63f682d61 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/ips" status: 200 len: 147 microversion: 2.1 time: 0.035822 Jun 16 00:43:30.516486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 445/893] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:43:30 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:43:33.249738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e37ea338-766a-4b9d-9cc0-5d1594c68231"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:33.251012 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:33.253877 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:33.253877 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=48 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:33.261387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:33.261852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:33.262603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:33.263037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:33.990427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4660b0dc-c4a1-46b6-9cca-381d080dd873 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745668 Jun 16 00:43:33.991015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 449/894] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:43:33 2022] POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:43:41.477913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c2965d7d-08a2-45ea-a7f8-998f1f648e12 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:41.485814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c2965d7d-08a2-45ea-a7f8-998f1f648e12 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:41.486270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c2965d7d-08a2-45ea-a7f8-998f1f648e12 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:41.545214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c2965d7d-08a2-45ea-a7f8-998f1f648e12 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Going to try to stop instance {{(pid=124722) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:43:41.704219 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c2965d7d-08a2-45ea-a7f8-998f1f648e12 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action" status: 202 len: 0 microversion: 2.1 time: 0.230555 Jun 16 00:43:41.704805 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 446/895] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:43:41 2022] POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 00:43:41.714962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:41.715662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:41.722051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:41.722503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:41.723272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:41.723711 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:41.854212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:41.862207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7457d470-b658-4ff8-a19d-97ac2502b9fa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.152650 Jun 16 00:43:41.871604 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 450/896] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:41 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:42.880180 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:42.880825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:42.886933 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:42.887383 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:42.888137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:42.888600 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:43.017820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:43.025659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5ea963e7-45a8-43cb-a04b-cb30293d7d96 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.150200 Jun 16 00:43:43.026717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 447/897] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:42 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:44.043576 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:44.044204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:44.050860 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:44.051315 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:44.052085 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:44.052555 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:44.176661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:44.185130 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a48a81f7-b64f-4b18-be89-62de21f1a07e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.145969 Jun 16 00:43:44.185693 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 451/898] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:44 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:45.202522 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:45.203162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:45.209650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:45.210129 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:45.210887 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:45.211325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:45.336634 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:45.344465 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-da473b49-2e38-4043-8317-534abf5b6f9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.146316 Jun 16 00:43:45.345045 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 448/899] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:45 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:46.362027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:46.362641 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:46.369238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:46.370293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:46.371055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:46.371494 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:46.498377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:46.506179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5c7dabca-e756-4ae4-8606-27f029bbe018 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.148033 Jun 16 00:43:46.506734 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 452/900] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:46 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:47.523132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:47.523772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:47.530778 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:47.531228 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:47.531982 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:47.532417 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:47.660901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:47.669405 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-20bb1711-eabc-4556-ba43-11aae4c26474 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.150177 Jun 16 00:43:47.669966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 449/901] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:47 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:48.686564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:48.687169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:48.693782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:48.694322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:48.695088 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:48.695528 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:48.824961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:48.832938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c5e1aa06-ae23-4bca-90c7-75de683cded1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.150337 Jun 16 00:43:48.833502 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 453/902] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:48 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:49.849536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:49.850068 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:49.857162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:49.857615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:49.858375 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:49.858811 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:49.990161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:49.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-00ed318e-f9a5-420e-b385-a57cbfdb0db1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.152365 Jun 16 00:43:49.998525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 450/903] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:49 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:51.014531 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:51.015142 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:51.021671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:51.022127 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:51.022889 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:51.023331 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:51.148679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:51.157075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ed4f89ff-7f46-475f-97da-eae957ac6b81 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.146375 Jun 16 00:43:51.157640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 454/904] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:51 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:52.174311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:52.175101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:52.181291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:52.181749 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:52.183134 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:52.183573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:52.332667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:52.340539 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-15c10af2-cfa1-4ba2-ad89-9dfaa43d23df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.170336 Jun 16 00:43:52.341108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 451/905] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:52 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:53.357691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:53.358299 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:53.364810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:53.365261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:53.366023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:53.366461 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:53.499046 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:53.507031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e69a0a33-4a46-4fcc-9472-2920db56b576 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.153331 Jun 16 00:43:53.507582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 455/906] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:53 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:54.524654 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:54.525270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:54.532448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:54.532944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:54.533704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:54.534141 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:54.672254 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:54.680170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b8419250-dfcc-4683-9ded-380f19b62160 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.159364 Jun 16 00:43:54.680755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 452/907] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:54 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:55.696674 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:55.697540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:55.704088 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:55.708376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:55.708376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:55.708376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:55.831617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:55.840065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-81cb9fa6-9fe3-46cd-8155-3d17751c93e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.147341 Jun 16 00:43:55.840638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 456/908] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:55 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:56.856412 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:56.856979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:56.863583 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:56.864033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:56.864822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:56.865258 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:56.990642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:56.998478 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4cf68e9d-d3d0-48ad-b6ac-a81862b43f09 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1725 microversion: 2.1 time: 0.146074 Jun 16 00:43:56.999023 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 453/909] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:56 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:58.015373 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:58.015974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:58.022714 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.023177 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.023948 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.024390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.154761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:58.162548 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-80126c72-a74b-4d15-afe1-b50e1ad2c39d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1702 microversion: 2.1 time: 0.151127 Jun 16 00:43:58.163121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 457/910] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:58 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1702 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:58.179259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ea3e85ff-b6d6-485e-b9fb-cb6eb2d3e8c5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:43:58.185694 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ea3e85ff-b6d6-485e-b9fb-cb6eb2d3e8c5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.186147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ea3e85ff-b6d6-485e-b9fb-cb6eb2d3e8c5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.207979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ea3e85ff-b6d6-485e-b9fb-cb6eb2d3e8c5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Going to try to start instance {{(pid=124722) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:43:58.403599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ea3e85ff-b6d6-485e-b9fb-cb6eb2d3e8c5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action" status: 202 len: 0 microversion: 2.1 time: 0.227841 Jun 16 00:43:58.404115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 454/911] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:43:58 2022] POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:43:58.412496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:58.413212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:58.419308 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.419757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.420516 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:58.420976 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:58.548490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:58.556645 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0a4bdae1-0bf4-4314-876a-8b1c03661fd5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1711 microversion: 2.1 time: 0.148232 Jun 16 00:43:58.557739 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 458/912] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:58 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1711 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:43:59.574542 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:43:59.575232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:43:59.581520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.581967 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:59.582764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:43:59.583196 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:43:59.718084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:43:59.726118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-53fe3e86-23d2-4f8b-9e24-50be8f19cb8c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1711 microversion: 2.1 time: 0.156493 Jun 16 00:43:59.726685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 455/913] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:43:59 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:00.743319 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:00.743925 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:00.750374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:00.750859 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:00.751700 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:00.752134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:00.877535 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:00.885919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2aba5e9e-f135-4d00-a2f8-07cc18218056 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1715 microversion: 2.1 time: 0.145844 Jun 16 00:44:00.886476 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:00 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1715 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:32.962922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:32.963526 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:32.965695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=22 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:32.966346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:32.971768 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:32.972337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:32.973231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:32.973685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:33.057064 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lazy-loading 'services' on Instance uuid d6d495c1-980b-4b00-8770-6f4be830077b {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:44:33.266507 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-deb2516c-a797-4523-a53e-f6870093b11c tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments/e37ea338-766a-4b9d-9cc0-5d1594c68231" status: 202 len: 0 microversion: 2.1 time: 0.308002 Jun 16 00:44:33.268626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 456/915] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:44:32 2022] DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments/e37ea338-766a-4b9d-9cc0-5d1594c68231 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:44:34.380107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6928a89b-7778-4944-96f3-0d8f6a38b20f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:34.384061 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=22 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:34.384061 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:34.387848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6928a89b-7778-4944-96f3-0d8f6a38b20f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:34.388293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6928a89b-7778-4944-96f3-0d8f6a38b20f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:34.450607 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6928a89b-7778-4944-96f3-0d8f6a38b20f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Going to try to stop instance {{(pid=124721) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 00:44:34.665365 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6928a89b-7778-4944-96f3-0d8f6a38b20f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action" status: 202 len: 0 microversion: 2.1 time: 0.289629 Jun 16 00:44:34.665974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 460/916] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:44:34 2022] POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:44:34.675183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:34.675895 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:34.682210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:34.687133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:34.687133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:34.687133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:34.922391 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:34.930327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-82b131c9-1b1f-4617-a3db-21199c1c71df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.259916 Jun 16 00:44:34.930872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 457/917] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:34 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:35.948404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:35.949142 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:35.955784 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:35.956235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:35.957034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:35.957482 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:36.143533 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:36.151049 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b72cb599-3a1e-400e-992b-a367ac097389 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.207662 Jun 16 00:44:36.151873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 461/918] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:35 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:37.168835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:37.169442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:37.175841 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:37.176295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:37.177083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:37.177519 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:37.299690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:37.306979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9b32ccc8-2bdc-4930-a7dd-7372fd681688 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.141963 Jun 16 00:44:37.307528 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 458/919] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:37 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:38.323945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:38.324660 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:38.330537 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:38.330989 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:38.331746 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:38.332172 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:38.467281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:38.475485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-22a4c31c-1e23-4295-8c28-6c6942a7b8e5 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.156189 Jun 16 00:44:38.476036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 462/920] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:38 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:39.492598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:39.493206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:39.499586 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:39.500033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:39.500811 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:39.501250 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:39.632847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:39.640703 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-16db8213-1fc0-436b-bfe4-077dbfc2efa9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.151979 Jun 16 00:44:39.641260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 459/921] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:39 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:40.658348 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:40.658957 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:40.665489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:40.665939 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:40.666699 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:40.667138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:40.795732 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:40.803722 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c6dd3651-d04b-4a55-a38a-e69b2cb04479 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.149337 Jun 16 00:44:40.804289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 463/922] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:40 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:41.820810 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:41.821420 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:41.828107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:41.828591 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:41.829350 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:41.830280 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:41.956186 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:41.963678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6b4fa0fd-0018-4834-9a8b-661d14676105 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.146784 Jun 16 00:44:41.964239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 460/923] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:41 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:42.981379 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:42.981918 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:42.988949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:42.989402 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:42.990167 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:42.990605 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:43.119374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:43.127464 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b016ac81-6887-4976-b015-ef9655e203fc tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.149506 Jun 16 00:44:43.128026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 464/924] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:42 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:44.144229 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:44.144873 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:44.151457 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:44.151906 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:44.152697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:44.153136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:44.287710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:44.295092 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-857c8a8e-c2ff-401d-9143-9b97bdaa4215 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1679 microversion: 2.1 time: 0.154729 Jun 16 00:44:44.295652 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 461/925] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:44 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:45.312153 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:45.312799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:45.319944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.320405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.321204 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.321645 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.448442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:45.456600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-fbf14125-6eca-46f6-94ae-c48610d167c3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1656 microversion: 2.1 time: 0.148291 Jun 16 00:44:45.457161 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 465/926] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:45 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1656 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:45.473410 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-157f44b8-7e81-4a40-ba20-e699d4046652 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:44:45.479839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-157f44b8-7e81-4a40-ba20-e699d4046652 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.480287 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-157f44b8-7e81-4a40-ba20-e699d4046652 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.502565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-157f44b8-7e81-4a40-ba20-e699d4046652 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Going to try to start instance {{(pid=124722) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 00:44:45.665078 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-157f44b8-7e81-4a40-ba20-e699d4046652 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action" status: 202 len: 0 microversion: 2.1 time: 0.195898 Jun 16 00:44:45.665681 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 462/927] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:44:45 2022] POST /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:44:45.674848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:45.675883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:45.684810 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.685298 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.686078 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:45.686518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:45.815541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:45.823570 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-460d6401-6fc9-409c-b0fe-1be88b0d98a6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1665 microversion: 2.1 time: 0.153205 Jun 16 00:44:45.824140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 466/928] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:45 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:46.574428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:44:46.574977 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:44:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:44:46.841598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:46.842237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:46.849104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:46.849565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:46.850339 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:46.850787 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:46.977249 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:46.984711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8ae15da9-6e2b-4a88-9508-19783eab3f82 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1665 microversion: 2.1 time: 0.147898 Jun 16 00:44:46.985277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 463/929] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:46 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:48.002710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:44:48.003323 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:44:48.009807 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:48.010254 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:48.011012 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:44:48.011444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:44:48.143648 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:44:48.151325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-aae0b2d6-5401-4766-9133-0372daf369aa tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1669 microversion: 2.1 time: 0.152942 Jun 16 00:44:48.151890 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 467/930] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:44:47 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:44:55.960789 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:44:55.961245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:45:04.269828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:04.270490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:04.272599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=16 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:04.273254 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:04.277898 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:04.278343 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:04.279088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:04.279516 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:04.304189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:45:04.627367 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bec2373c-9680-4914-bbd8-963d11d7a6f6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 204 len: 0 microversion: 2.1 time: 0.361116 Jun 16 00:45:04.628515 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 464/931] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:45:04 2022] DELETE /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:45:04.636756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:04.637407 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:04.639769 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=16 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:04.640437 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:04.645839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:04.646288 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:04.647055 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:04.647495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:04.779094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:04.787261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a1bfedb7-155e-4114-b288-314d0b931fd8 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1577 microversion: 2.1 time: 0.154504 Jun 16 00:45:04.787817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 468/932] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:04 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:05.804273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:05.805029 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:05.811413 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:05.811865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:05.812649 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:05.813084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:05.947644 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:05.955509 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2d3138ba-fd94-413c-968e-b2f18417bc5b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1577 microversion: 2.1 time: 0.155561 Jun 16 00:45:05.956668 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 465/933] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:05 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:06.973225 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:06.973759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:06.982542 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:06.982992 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:06.983864 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:06.984303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:07.046818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:07.055333 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-49f56d59-4ea0-4eb3-b205-3a7bbe3c564a tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1510 microversion: 2.1 time: 0.086086 Jun 16 00:45:07.055886 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 469/934] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:06 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:07.201317 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-720d5834-e118-49cd-a21d-75bd0366ad4e req-a61ce047-911b-41f8-9a34-1a28eb09932d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cfd9b5-deae-43b6-a743-de414f1ed662", "name": "network-vif-deleted", "tag": "d5fb2be2-9506-4ad0-9b2c-6c4b7429291b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:07.210926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-720d5834-e118-49cd-a21d-75bd0366ad4e req-a61ce047-911b-41f8-9a34-1a28eb09932d service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:07.211365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-720d5834-e118-49cd-a21d-75bd0366ad4e req-a61ce047-911b-41f8-9a34-1a28eb09932d service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:07.375231 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-720d5834-e118-49cd-a21d-75bd0366ad4e req-a61ce047-911b-41f8-9a34-1a28eb09932d service nova] Creating event network-vif-deleted:d5fb2be2-9506-4ad0-9b2c-6c4b7429291b for instance b9cfd9b5-deae-43b6-a743-de414f1ed662 on hv-cinder-80382 Jun 16 00:45:07.381502 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-720d5834-e118-49cd-a21d-75bd0366ad4e req-a61ce047-911b-41f8-9a34-1a28eb09932d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184010 Jun 16 00:45:07.382051 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 466/935] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:08.071755 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:08.072396 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:08.079141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:08.079605 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:08.080379 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:08.081019 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:08.114312 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:08.114758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:08.115203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lazy-loading 'fault' on Instance uuid b9cfd9b5-deae-43b6-a743-de414f1ed662 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:45:08.155959 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:08.163450 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-45e9fbed-6313-4801-bce2-538a425bdc18 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 200 len: 1230 microversion: 2.1 time: 0.095612 Jun 16 00:45:08.164043 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 470/936] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:08 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:09.182295 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:09.182981 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:09.189480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:09.189931 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:09.190764 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:09.191203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:09.204924 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] HTTP exception thrown: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Request method failure captured: Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 HTTP/1.1 Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnxoO9ghD0N90Begoj2wLwpp6Dd8Pb00SM7fZ-mkM_BnRqb5qPuQ6euFtzESujJ6cQBkb1hdmKHsqaY5kDuoIBdM6w8fb6Usg93l3vjUPz2pkBfOubzrcCpXelnvdU1OypkiBpXaNoTlRZQjl17xeO4dkk47QNzOqTnWMRvEHDMo_fw Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:45:09.207099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}] Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: 517928d85b764c089c6dd5b2d088639c Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:45:09.208673 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'b9cfd9b5-deae-43b6-a743-de414f1ed662'} Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:45:09.209529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:45:09.211237 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:09.212755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Returning 404 to user: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:45:09.212755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2e9e10ea-641e-4b1c-b4ae-e48da625eeee tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 404 len: 111 microversion: 2.1 time: 0.030931 Jun 16 00:45:09.212755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 467/937] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:09 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:45:09.302558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1679033286", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530055099", "security_groups": [{"name": "tempest-secgroup-smoke-298912126"}], "block_device_mapping_v2": [{"uuid": "3b037b59-d9dd-479e-87d1-96d99a9c0914", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "edd9d18b-1d6c-4052-b07a-8baf4adc8bec"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:09.410442 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] validate_networks() for [('edd9d18b-1d6c-4052-b07a-8baf4adc8bec', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:45:09.786852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:45:09.787277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:45:09.787748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:45:09.788158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:45:09.788609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:45:09.797314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:09.797766 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:09.798572 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:09.799007 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:09.815712 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:45:09.819640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for user 517928d85b764c089c6dd5b2d088639c and project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:45:09.876103 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:45:09.878740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b037b59-d9dd-479e-87d1-96d99a9c0914',volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:45:10.264109 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a52757af-d446-45e9-8793-32d8902ee5d9 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.965282 Jun 16 00:45:10.265129 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 471/938] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:45:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:45:10.275413 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-935d5994-088f-4040-b036-5bba65e220bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:10.276740 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-935d5994-088f-4040-b036-5bba65e220bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:10.336685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-935d5994-088f-4040-b036-5bba65e220bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:10.343566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-935d5994-088f-4040-b036-5bba65e220bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1094 microversion: 2.1 time: 0.072216 Jun 16 00:45:10.344481 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 468/939] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:10 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:11.360574 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:11.361166 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:11.372230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:11.372230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:11.372230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:11.372230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:11.430444 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:11.438051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-27405a48-30ac-4fff-bf4e-d45acd26bbda tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1144 microversion: 2.1 time: 0.081459 Jun 16 00:45:11.438609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 472/940] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:11 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:12.455241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:12.455792 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:12.463699 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:12.464144 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:12.465033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:12.465520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:12.528697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:12.536162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fc99b799-72d6-455e-ab1d-def03f1491bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1210 microversion: 2.1 time: 0.084827 Jun 16 00:45:12.536795 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 469/941] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:12 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:13.557952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:13.558568 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:13.565297 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:13.566298 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:13.567079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:13.567522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:13.700685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:13.709120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-32fd9643-cd69-4145-85da-9f08e4aaf9bf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1277 microversion: 2.1 time: 0.154936 Jun 16 00:45:13.709709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 473/942] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:13 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:14.250814 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-4fa1e004-a0ec-4645-b131-acf77f3eab74 req-76176079-7c1b-48ca-bab4-ea6ae79739a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c407165e-8822-4cbe-a4b4-cdd515e2c048", "tag": "04943923-128c-4497-8f50-577da86b34e2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:14.260136 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4fa1e004-a0ec-4645-b131-acf77f3eab74 req-76176079-7c1b-48ca-bab4-ea6ae79739a2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:14.260732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-4fa1e004-a0ec-4645-b131-acf77f3eab74 req-76176079-7c1b-48ca-bab4-ea6ae79739a2 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:14.272916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-4fa1e004-a0ec-4645-b131-acf77f3eab74 req-76176079-7c1b-48ca-bab4-ea6ae79739a2 service nova] Creating event network-changed:04943923-128c-4497-8f50-577da86b34e2 for instance c407165e-8822-4cbe-a4b4-cdd515e2c048 on hv-cinder-80382 Jun 16 00:45:14.278022 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-4fa1e004-a0ec-4645-b131-acf77f3eab74 req-76176079-7c1b-48ca-bab4-ea6ae79739a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031498 Jun 16 00:45:14.278855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 470/943] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:14.725812 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:14.726577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:14.733037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:14.733493 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:14.734268 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:14.734710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:14.867344 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:14.874951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bbfba8ea-b167-4cb4-8ee4-e9c7747b09f5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.153006 Jun 16 00:45:14.875514 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 474/944] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:14 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:15.893563 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:15.894804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:15.901137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:15.901596 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:15.902360 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:15.902800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:16.032543 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:16.039880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ef0befb9-ce0e-4ad4-8587-a70cc13de3e6 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.151187 Jun 16 00:45:16.040450 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 471/945] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:15 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:17.056809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:17.057425 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:17.063857 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:17.064311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:17.065138 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:17.066073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:17.192936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:17.200627 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-86aa952d-55a5-49f5-85de-2cd68bda4528 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.147905 Jun 16 00:45:17.201183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 475/946] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:17 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:18.217917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:18.218435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:18.224855 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:18.225309 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:18.226066 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:18.226501 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:18.352049 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:18.359506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e5ef3c47-e695-4a6e-9a96-98691ecee820 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.145541 Jun 16 00:45:18.360056 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 472/947] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:18 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:19.376564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:19.377179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:19.383688 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:19.384140 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:19.384928 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:19.385372 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:19.512808 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:19.520813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7bbd4530-34aa-4577-ad94-322c5cedd171 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.148111 Jun 16 00:45:19.521613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 476/948] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:19 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:20.143038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:20.144672 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:20.150817 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.151271 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.152026 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.152463 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.179752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-20841662-5e01-4b3f-a31e-65d51e8f26c9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040553 Jun 16 00:45:20.180284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 473/949] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:45:20 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:45:20.237428 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:20.237964 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:20.239762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:20.240565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:20.245167 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.245618 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.246379 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.246811 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.271882 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:45:20.537278 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:20.537889 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:20.539800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:20.544545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.545083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.545840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.546276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.605011 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6e2d8e84-7a2c-4a7c-b694-570e1e4e409f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 204 len: 0 microversion: 2.1 time: 0.371060 Jun 16 00:45:20.605603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 477/950] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:45:20 2022] DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:45:20.614428 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:20.615249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:20.621943 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.622200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.630873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:20.631340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:20.680511 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:20.688122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d8e68fdb-513f-4e68-91c8-da51504cb026 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.154725 Jun 16 00:45:20.688696 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 474/951] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:20 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:20.764962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:20.772576 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-74e2d11d-d962-4252-a231-7eb1917ba410 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1675 microversion: 2.1 time: 0.162641 Jun 16 00:45:20.773190 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 478/952] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:20 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:21.705955 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:21.707091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:21.713591 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:21.714041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:21.714786 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:21.715215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:21.789579 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:21.790380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:21.800063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:21.800515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:21.801306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:21.801741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:21.862569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:21.862569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-bb43b505-c74a-4a70-a5b7-d83fcee03088 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.155917 Jun 16 00:45:21.862569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 475/953] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:21 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:21.931602 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:21.939001 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-483a9cab-7299-4344-b5c6-0090f7ffa58a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1675 microversion: 2.1 time: 0.153238 Jun 16 00:45:21.939562 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 479/954] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:21 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:22.874303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:22.874892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:22.881315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:22.881762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:22.882529 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:22.882942 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:22.956977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:22.957689 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:22.964267 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:22.964746 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:22.965503 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:22.965932 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:23.015210 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:23.023091 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b4ed69b5-8b77-4b1e-b9f6-9c5b512d9c21 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.152642 Jun 16 00:45:23.023645 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 476/955] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:22 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:23.100066 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:23.107507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b7de2b2d-51dc-466e-b5a3-fde3d86959a9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1675 microversion: 2.1 time: 0.154956 Jun 16 00:45:23.108152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 480/956] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:22 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:24.039685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:24.040388 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:24.047241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.047558 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.048554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.049161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.133177 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-2eabfb2b-0404-40ac-9e4b-b707965d7801 req-4c44a549-337b-4bee-914a-43402fa37640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d495c1-980b-4b00-8770-6f4be830077b", "name": "network-vif-deleted", "tag": "69e9c668-803b-42f4-8d52-2232717ce29c"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:24.144047 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2eabfb2b-0404-40ac-9e4b-b707965d7801 req-4c44a549-337b-4bee-914a-43402fa37640 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.145193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-2eabfb2b-0404-40ac-9e4b-b707965d7801 req-4c44a549-337b-4bee-914a-43402fa37640 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.158198 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-2eabfb2b-0404-40ac-9e4b-b707965d7801 req-4c44a549-337b-4bee-914a-43402fa37640 service nova] Creating event network-vif-deleted:69e9c668-803b-42f4-8d52-2232717ce29c for instance d6d495c1-980b-4b00-8770-6f4be830077b on hv-cinder-80382 Jun 16 00:45:24.164416 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-2eabfb2b-0404-40ac-9e4b-b707965d7801 req-4c44a549-337b-4bee-914a-43402fa37640 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120926 Jun 16 00:45:24.165551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 481/957] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:24.172106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:24.172997 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:24.180671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.181384 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.182165 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.182601 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.224199 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:24.235789 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9f6aa27a-5a2b-440a-9739-b496ddd8a5b4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.199862 Jun 16 00:45:24.236614 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 477/958] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:24 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:24.266792 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:24.285708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1d274cc6-6566-4185-aceb-862f621c4017 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 200 len: 1607 microversion: 2.1 time: 0.118728 Jun 16 00:45:24.286430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 482/959] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:24 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 1607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:24.552704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-e320329c-6c86-4fe4-ab16-188f8baa7809 req-1f183cdb-8aff-4676-a026-06baa510c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c407165e-8822-4cbe-a4b4-cdd515e2c048", "name": "network-vif-plugged", "status": "completed", "tag": "04943923-128c-4497-8f50-577da86b34e2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:24.560866 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-e320329c-6c86-4fe4-ab16-188f8baa7809 req-1f183cdb-8aff-4676-a026-06baa510c8ca service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:24.561315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-e320329c-6c86-4fe4-ab16-188f8baa7809 req-1f183cdb-8aff-4676-a026-06baa510c8ca service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:24.572470 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-e320329c-6c86-4fe4-ab16-188f8baa7809 req-1f183cdb-8aff-4676-a026-06baa510c8ca service nova] Creating event network-vif-plugged:04943923-128c-4497-8f50-577da86b34e2 for instance c407165e-8822-4cbe-a4b4-cdd515e2c048 on hv-cinder-80382 Jun 16 00:45:24.578720 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-e320329c-6c86-4fe4-ab16-188f8baa7809 req-1f183cdb-8aff-4676-a026-06baa510c8ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028945 Jun 16 00:45:24.578720 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 478/960] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:25.253162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:25.258433 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:25.260847 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:25.261298 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:25.262081 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:25.262515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:25.303342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:25.304217 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:25.313147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:25.313638 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:25.314456 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:25.314904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:25.329984 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b HTTP/1.1 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:45:25.332490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:45:25.334230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'd6d495c1-980b-4b00-8770-6f4be830077b'} Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:45:25.335209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:45:25.336803 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:45:25.338968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:45:25.340017 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b05aba50-bc29-46ec-8f16-d6bc84e5a9f3 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 404 len: 111 microversion: 2.1 time: 0.041455 Jun 16 00:45:25.340779 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 479/961] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:25 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:45:25.349400 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2838b7df-1aa1-4709-a2ec-014592b579f6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '.version_select at 0x7f2a83c96ee0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:25.407029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:25.410658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:25.414936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d2be282a-6486-4282-9c9c-3e9d534ad424 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.166172 Jun 16 00:45:25.415492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 483/962] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:25 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:25.451760 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2838b7df-1aa1-4709-a2ec-014592b579f6 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363522292" status: 202 len: 0 microversion: 2.1 time: 0.106418 Jun 16 00:45:25.452344 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 480/963] 10.222.0.20 () {58 vars in 1217 bytes} [Thu Jun 16 00:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363522292 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:45:26.186676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3673a861-e9f4-4c5a-adcf-1480b33a9254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: .version_select at 0x7f2a7b484160>, body: {"keypair": {"name": "tempest-keypair-1805721592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1vXeam63Gq0G32fnISOkuG8WRBzY8iYLpsJdXc1N7yzUs8TmbVtOCQB0n5K5I5cOQU6JASWtMqdTdvkV/7S0raHFFHK0SczilF0p3rOps6e8uVYi5x+JU4k+Mj5VFWFw=="}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:26.202119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-3673a861-e9f4-4c5a-adcf-1480b33a9254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:45:26.205895 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-3673a861-e9f4-4c5a-adcf-1480b33a9254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for user b3e4c68725cb4a9ea9024c3205dd5588 and project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'key_pairs'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:45:26.342691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3673a861-e9f4-4c5a-adcf-1480b33a9254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159980 Jun 16 00:45:26.343357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 484/964] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:45:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:26.431618 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:26.432234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:26.439598 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:26.440046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:26.441471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:26.441905 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:26.596471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:26.603957 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-878ddd53-c78d-4a47-ba95-03ce4c1ef0e4 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1265 microversion: 2.1 time: 0.176264 Jun 16 00:45:26.604545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 481/965] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:26 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:27.622181 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:27.622791 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:27.630169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:27.630707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:27.631380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:27.631819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:27.837421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:27.844875 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-28ffb2b7-03d7-4bbb-b86a-9c45bc09cc19 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1453 microversion: 2.1 time: 0.227437 Jun 16 00:45:27.845439 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 485/966] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:27 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:27.861451 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:27.861974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:27.868701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:27.869148 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:27.869937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:27.870430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:28.012651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:28.020497 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d7bd31c0-cbd3-4bc0-822f-aaf0dfd50bf2 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1453 microversion: 2.1 time: 0.163004 Jun 16 00:45:28.021096 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 482/967] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:27 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:28.687591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1305599747", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4929321f-89e1-434e-a080-491c8ce8d5b1"}], "security_groups": [{"name": "tempest-securitygroup--532771341"}], "key_name": "tempest-keypair-1805721592", "user_data": "}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:28.795491 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] validate_networks() for [('4929321f-89e1-434e-a080-491c8ce8d5b1', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:45:29.161377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:45:29.161800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:45:29.162466 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:45:29.163004 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:45:29.163425 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:45:29.172551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:29.173041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:29.173843 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:29.174283 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:29.193569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:45:29.198339 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Getting quotas for user b3e4c68725cb4a9ea9024c3205dd5588 and project f8eb9ad6ea03410f9956bbabeddcd5b2. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:45:29.210086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:45:29.212357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:45:29.355293 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-095facc7-7321-42d7-bcdd-49c583153ad7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.671789 Jun 16 00:45:29.356580 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 486/968] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:45:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:45:29.366966 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d4caba46-fbe2-401f-9e31-46709edf0703 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:29.368396 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d4caba46-fbe2-401f-9e31-46709edf0703 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:29.473857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d4caba46-fbe2-401f-9e31-46709edf0703 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:29.484468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d4caba46-fbe2-401f-9e31-46709edf0703 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1238 microversion: 2.1 time: 0.121729 Jun 16 00:45:29.485212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 483/969] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:29 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:29.938456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-a8ab8461-42cc-45fc-ad9f-11bdc097e930 req-8460f0d3-d598-436f-b869-cbf47bf28f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c407165e-8822-4cbe-a4b4-cdd515e2c048", "tag": "04943923-128c-4497-8f50-577da86b34e2"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:29.948477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a8ab8461-42cc-45fc-ad9f-11bdc097e930 req-8460f0d3-d598-436f-b869-cbf47bf28f39 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:29.949231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-a8ab8461-42cc-45fc-ad9f-11bdc097e930 req-8460f0d3-d598-436f-b869-cbf47bf28f39 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:29.961849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-a8ab8461-42cc-45fc-ad9f-11bdc097e930 req-8460f0d3-d598-436f-b869-cbf47bf28f39 service nova] Creating event network-changed:04943923-128c-4497-8f50-577da86b34e2 for instance c407165e-8822-4cbe-a4b4-cdd515e2c048 on hv-cinder-80382 Jun 16 00:45:29.966757 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-a8ab8461-42cc-45fc-ad9f-11bdc097e930 req-8460f0d3-d598-436f-b869-cbf47bf28f39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031986 Jun 16 00:45:29.967455 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 487/970] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:30.501590 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:30.502204 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:30.511876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:30.512904 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:30.513131 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:30.513569 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:30.593626 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:30.607303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-fee72a0e-ce2c-43d4-a426-aa1f14928307 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1242 microversion: 2.1 time: 0.105241 Jun 16 00:45:30.607303 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 484/971] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:30 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:31.620627 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:31.621316 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:31.627785 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:31.628477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:31.629261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:31.629695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:31.692006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:31.699707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3c129777-65c1-4310-8463-6f75dd7af0f7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1308 microversion: 2.1 time: 0.083960 Jun 16 00:45:31.700560 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 488/972] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:31 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:32.717363 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:32.718048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:32.725154 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:32.725623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:32.726388 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:32.726824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:32.731274 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:32.929406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:32.937035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f96d6408-5ff5-41f5-ba9d-b13a9ed653df tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.223459 Jun 16 00:45:32.937666 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 485/973] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:32 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:33.129459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-5085fad3-f933-45c9-9c55-96d6c11d98f3 req-ddb181de-377e-439b-b753-4f958557b9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f367a4d-3843-4e90-acf8-526e74bd1583", "tag": "10418ad5-9d41-4b7e-bd9d-0e56b4427fe6"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:33.143370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-5085fad3-f933-45c9-9c55-96d6c11d98f3 req-ddb181de-377e-439b-b753-4f958557b9f7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:33.143370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-5085fad3-f933-45c9-9c55-96d6c11d98f3 req-ddb181de-377e-439b-b753-4f958557b9f7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:33.172026 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-5085fad3-f933-45c9-9c55-96d6c11d98f3 req-ddb181de-377e-439b-b753-4f958557b9f7 service nova] Creating event network-changed:10418ad5-9d41-4b7e-bd9d-0e56b4427fe6 for instance 1f367a4d-3843-4e90-acf8-526e74bd1583 on hv-cinder-80382 Jun 16 00:45:33.178318 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-5085fad3-f933-45c9-9c55-96d6c11d98f3 req-ddb181de-377e-439b-b753-4f958557b9f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057596 Jun 16 00:45:33.179043 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 489/974] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:33.956615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:33.956615 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:33.962842 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:33.963291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:33.964053 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:33.964492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:34.096788 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:34.106568 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-830e64a7-16c8-44f6-ac1a-2f5b368698e2 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.154634 Jun 16 00:45:34.107298 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 486/975] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:33 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:45:35.125227 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:35.125931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:35.128342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:35.133306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:35.139418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:35.139418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:35.139418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:35.272763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:35.280423 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-6e55de42-4218-4903-8042-1dc683d03fce tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.159425 Jun 16 00:45:35.281021 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 490/976] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:35 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:36.297486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:36.298162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:36.300508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:36.305322 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:36.305769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:36.306518 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:36.306950 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:36.436030 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:36.443334 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a0b36a9d-0548-4581-a916-78dcfd380a88 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.149700 Jun 16 00:45:36.443899 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 487/977] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:36 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:37.460305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:37.460929 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:37.467376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:37.467809 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:37.468591 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:37.469025 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:37.606583 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:37.609020 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-37bbcac6-1311-481f-9d50-9d8f153176e1 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.152577 Jun 16 00:45:37.609575 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 491/978] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:37 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:38.187112 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-8bae3a87-5b6e-4a3b-963c-3e06c5377e2d req-5e37d9c3-95da-465e-909f-44e7b4265c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f367a4d-3843-4e90-acf8-526e74bd1583", "name": "network-vif-plugged", "status": "completed", "tag": "10418ad5-9d41-4b7e-bd9d-0e56b4427fe6"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:38.196704 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8bae3a87-5b6e-4a3b-963c-3e06c5377e2d req-5e37d9c3-95da-465e-909f-44e7b4265c29 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:38.197150 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8bae3a87-5b6e-4a3b-963c-3e06c5377e2d req-5e37d9c3-95da-465e-909f-44e7b4265c29 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:38.208737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-8bae3a87-5b6e-4a3b-963c-3e06c5377e2d req-5e37d9c3-95da-465e-909f-44e7b4265c29 service nova] Creating event network-vif-plugged:10418ad5-9d41-4b7e-bd9d-0e56b4427fe6 for instance 1f367a4d-3843-4e90-acf8-526e74bd1583 on hv-cinder-80382 Jun 16 00:45:38.213664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-8bae3a87-5b6e-4a3b-963c-3e06c5377e2d req-5e37d9c3-95da-465e-909f-44e7b4265c29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030468 Jun 16 00:45:38.214239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 488/979] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:38.625797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:38.626419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:38.633830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:38.634289 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:38.635061 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:38.635498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:38.766052 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:38.773402 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cc45bd20-2d71-4a41-b5ec-a2d9ae596453 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1363 microversion: 2.1 time: 0.151509 Jun 16 00:45:38.773962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 492/980] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:38 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:39.787782 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:39.791883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:39.792610 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:39.798685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:39.799138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:39.799897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:39.800335 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:39.927041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:45:39.934678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-1b58dae4-4581-4dbd-845a-a3cf0cbf48c0 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1549 microversion: 2.1 time: 0.148264 Jun 16 00:45:39.935232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 489/981] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:45:39 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:45:39.951488 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:45:39.952045 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:45:39.953869 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:39.954520 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=10 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:39.959818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:39.960273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:39.961144 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:39.961592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:40.048426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-db30cc90-835d-49ff-88b1-475be67c4d97 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100965 Jun 16 00:45:40.049185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 493/982] 10.222.0.20 () {58 vars in 1274 bytes} [Thu Jun 16 00:45:39 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:45:40.998021 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-11bb954c-1fc8-45ad-80b5-d79fbde920f7 req-d5caa5d8-ca26-4dc8-8844-9d8ec24d4a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f367a4d-3843-4e90-acf8-526e74bd1583", "tag": "10418ad5-9d41-4b7e-bd9d-0e56b4427fe6"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:45:41.006743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-11bb954c-1fc8-45ad-80b5-d79fbde920f7 req-d5caa5d8-ca26-4dc8-8844-9d8ec24d4a1b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:45:41.007286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-11bb954c-1fc8-45ad-80b5-d79fbde920f7 req-d5caa5d8-ca26-4dc8-8844-9d8ec24d4a1b service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:45:41.019829 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-11bb954c-1fc8-45ad-80b5-d79fbde920f7 req-d5caa5d8-ca26-4dc8-8844-9d8ec24d4a1b service nova] Creating event network-changed:10418ad5-9d41-4b7e-bd9d-0e56b4427fe6 for instance 1f367a4d-3843-4e90-acf8-526e74bd1583 on hv-cinder-80382 Jun 16 00:45:41.025448 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-11bb954c-1fc8-45ad-80b5-d79fbde920f7 req-d5caa5d8-ca26-4dc8-8844-9d8ec24d4a1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030616 Jun 16 00:45:41.026138 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 490/983] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:16.952210 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=7 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:16.952988 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=40 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:16.956892 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:16.957380 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:16.963312 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:16.966375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:16.966375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:16.966375 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:16.988661 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c9b3ecdc-18ed-42d4-b399-6e0880299d46 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/ips" status: 200 len: 146 microversion: 2.1 time: 0.037827 Jun 16 00:46:16.989213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 494/984] 10.222.0.20 () {58 vars in 1247 bytes} [Thu Jun 16 00:46:16 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:46:18.537459 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e097784-623f-4e32-8259-b9f51ce19315"}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:18.539121 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:18.541375 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=7 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:18.542072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=26 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:18.546944 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:18.552734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:18.552734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:18.552734 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:19.247078 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c5f003f5-b707-4ffc-bfec-fd63e299a3d9 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714053 Jun 16 00:46:19.247689 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 491/985] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:46:18 2022] POST /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:26.731819 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:26.732825 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:26.739399 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:26.739850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:26.740636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:26.741069 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:26.769973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-915b3fae-c4bb-4014-a8c3-0a007d72f6eb tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Jun 16 00:46:26.770518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 495/986] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:46:26 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:26.781402 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:26.781980 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:26.788179 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:26.788670 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:26.789430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:26.790381 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:26.819150 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cab7d7d9-69e7-4388-8f75-1f8ea1310b3f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315" status: 200 len: 194 microversion: 2.1 time: 0.042602 Jun 16 00:46:26.819731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 492/987] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jun 16 00:46:26 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:28.380764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baf03f0e-4d93-4f0b-a6a5-63dfbcfa20f8"}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:28.381817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:28.388818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:28.389264 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:28.390016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:28.390449 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:29.076374 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8f808773-4b70-4137-a0a5-93849780f702 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "POST /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699162 Jun 16 00:46:29.077018 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 496/988] 10.222.0.20 () {60 vars in 1322 bytes} [Thu Jun 16 00:46:28 2022] POST /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:36.565874 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:36.566965 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:36.573608 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.574054 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.575071 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.575506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.605435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d09f8560-729f-4627-a990-b58abc4b2321 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043411 Jun 16 00:46:36.605979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 493/989] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:46:36 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:36.750654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:36.751257 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:36.757945 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.758394 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.759214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.759664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.789278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-9372249f-ee88-4730-94fe-2be3e179259d tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315" status: 200 len: 194 microversion: 2.1 time: 0.042903 Jun 16 00:46:36.789851 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 497/990] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jun 16 00:46:36 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:36.799836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:36.800324 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:36.807244 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.807690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.808439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:36.808901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:36.886364 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lazy-loading 'services' on Instance uuid 1f367a4d-3843-4e90-acf8-526e74bd1583 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:46:37.105952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0dd56970-fa1b-4248-9dcb-d2482e8a9ac8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315" status: 202 len: 0 microversion: 2.1 time: 0.309731 Jun 16 00:46:37.106525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 494/991] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:46:36 2022] DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/9e097784-623f-4e32-8259-b9f51ce19315 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:46:39.271741 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:39.272231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:39.278764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:39.279218 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:39.279974 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:39.280413 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:39.308239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7dabeaea-35b9-4b06-a7cd-dbd2970b5254 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/baf03f0e-4d93-4f0b-a6a5-63dfbcfa20f8" status: 200 len: 194 microversion: 2.1 time: 0.040452 Jun 16 00:46:39.308824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 498/992] 10.222.0.20 () {58 vars in 1412 bytes} [Thu Jun 16 00:46:39 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/baf03f0e-4d93-4f0b-a6a5-63dfbcfa20f8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:46:39.319260 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:39.319846 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:39.326952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:39.327411 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:39.328169 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:39.328642 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:39.406161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lazy-loading 'services' on Instance uuid 1f367a4d-3843-4e90-acf8-526e74bd1583 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:46:39.590975 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0373b758-005b-4941-909d-746538603548 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/baf03f0e-4d93-4f0b-a6a5-63dfbcfa20f8" status: 202 len: 0 microversion: 2.1 time: 0.276111 Jun 16 00:46:39.591856 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 495/993] 10.222.0.20 () {58 vars in 1415 bytes} [Thu Jun 16 00:46:39 2022] DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments/baf03f0e-4d93-4f0b-a6a5-63dfbcfa20f8 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:46:40.747418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:40.748922 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:40.760414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.760414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:40.760414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.760414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:40.785286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bdebc448-b922-4f31-8c6a-69211bee3b43 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041725 Jun 16 00:46:40.785852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 499/994] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:46:40 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:46:40.889952 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:40.890971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:40.897179 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.897638 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:40.898420 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.898840 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:40.926864 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6d54146d-523a-4167-b3ef-14b3187a1b90 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041675 Jun 16 00:46:40.927409 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 496/995] 10.222.0.20 () {58 vars in 1301 bytes} [Thu Jun 16 00:46:40 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 00:46:40.983593 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:40.984183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:40.990124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.990574 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:40.991328 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:40.991761 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:41.016112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:46:41.265800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-36103a4e-0eab-434d-a9fc-869ba27362ca tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 204 len: 0 microversion: 2.1 time: 0.285764 Jun 16 00:46:41.266384 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 500/996] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:46:40 2022] DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:46:41.275099 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:41.277038 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:41.281731 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:41.282178 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:41.282932 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:41.283356 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:41.412232 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:41.419623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-79f5ba95-115c-4e93-ab7d-11cf2105c251 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1674 microversion: 2.1 time: 0.148884 Jun 16 00:46:41.420185 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 497/997] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:41 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:42.437538 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:42.438232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:42.444717 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:42.445169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:42.445923 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:42.446899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:42.582616 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:42.590956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e4ab595a-8827-4b3b-ae0b-08ce92c7e97f tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1674 microversion: 2.1 time: 0.157649 Jun 16 00:46:42.596254 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 501/998] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:42 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:43.608882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:43.609494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:43.615931 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:43.616379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:43.617170 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:43.617776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:43.838565 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:43.851184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-54cca8a5-dc29-4195-825b-8d01c9638813 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1674 microversion: 2.1 time: 0.241208 Jun 16 00:46:43.851184 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 498/999] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:43 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:44.340805 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-7a52d5d5-fc6d-4a44-82aa-dd3c3f60484e req-7db8e883-677a-48ef-80f3-8656c4921112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f367a4d-3843-4e90-acf8-526e74bd1583", "name": "network-vif-deleted", "tag": "10418ad5-9d41-4b7e-bd9d-0e56b4427fe6"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:46:44.349306 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7a52d5d5-fc6d-4a44-82aa-dd3c3f60484e req-7db8e883-677a-48ef-80f3-8656c4921112 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:44.349753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-7a52d5d5-fc6d-4a44-82aa-dd3c3f60484e req-7db8e883-677a-48ef-80f3-8656c4921112 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:44.360424 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-7a52d5d5-fc6d-4a44-82aa-dd3c3f60484e req-7db8e883-677a-48ef-80f3-8656c4921112 service nova] Creating event network-vif-deleted:10418ad5-9d41-4b7e-bd9d-0e56b4427fe6 for instance 1f367a4d-3843-4e90-acf8-526e74bd1583 on hv-cinder-80382 Jun 16 00:46:44.365326 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-7a52d5d5-fc6d-4a44-82aa-dd3c3f60484e req-7db8e883-677a-48ef-80f3-8656c4921112 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028243 Jun 16 00:46:44.365919 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 502/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:46:44.863780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:44.864382 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:44.872438 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:44.872937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:44.873701 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:44.874137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:44.904851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:44.905212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:44.905659 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lazy-loading 'fault' on Instance uuid 1f367a4d-3843-4e90-acf8-526e74bd1583 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:46:44.948304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e4c68725cb4a9ea9024c3205dd5588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eb9ad6ea03410f9956bbabeddcd5b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:46:44.956195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6bcbca70-d201-45c9-b4df-6ab1179807e8 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 200 len: 1328 microversion: 2.1 time: 0.096266 Jun 16 00:46:44.956796 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 499/1001] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:44 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:46:45.974377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:45.974986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:45.982080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:45.982196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:45.982888 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:45.983320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:45.996360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 HTTP/1.1 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:46:45.997971 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:45.999666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '1f367a4d-3843-4e90-acf8-526e74bd1583'} Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:46.000783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:46.002175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:46.003635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:46.003635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-21092657-007b-40ee-bae6-f9dd21968380 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 404 len: 111 microversion: 2.1 time: 0.029783 Jun 16 00:46:46.003635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 503/1002] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:45 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:46:46.008004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-dcf77c1d-fda8-45af-96d0-649473000c84 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '.version_select at 0x7f2a83bb15e0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:46.090101 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-dcf77c1d-fda8-45af-96d0-649473000c84 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805721592" status: 202 len: 0 microversion: 2.1 time: 0.085757 Jun 16 00:46:46.090675 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 500/1003] 10.222.0.20 () {58 vars in 1220 bytes} [Thu Jun 16 00:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805721592 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:46:49.250377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:49.250881 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:49.253301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:49.258051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:49.258509 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:49.259277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:49.259720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:49.273626 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 HTTP/1.1 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:46:49.275157 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.276770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '1f367a4d-3843-4e90-acf8-526e74bd1583'} Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:49.277550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.278845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.280095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:49.280095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7aab5a7d-2ff7-492d-96ed-1a2fbe3dfa4e tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 404 len: 111 microversion: 2.1 time: 0.029990 Jun 16 00:46:49.280095 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 504/1004] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:46:49 2022] DELETE /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:46:49.285504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:49.286112 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: 1f367a4d-3843-4e90-acf8-526e74bd1583] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:49.288065 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:49.293919 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:49.296426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:49.296426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:49.296426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:49.299370 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:49.309055 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 HTTP/1.1 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:46:49.310662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.312234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '1f367a4d-3843-4e90-acf8-526e74bd1583'} Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:49.313149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. Jun 16 00:46:49.314695 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:49.316100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance 1f367a4d-3843-4e90-acf8-526e74bd1583 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:49.316100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6646099e-c47e-4db0-ab13-ea002ee446ab tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583" status: 404 len: 111 microversion: 2.1 time: 0.030938 Jun 16 00:46:49.316100 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 501/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:49 2022] GET /compute/v2.1/servers/1f367a4d-3843-4e90-acf8-526e74bd1583 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:46:50.585938 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:50.586428 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:50.593834 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:50.594288 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:50.595112 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:50.595548 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:50.609719 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b HTTP/1.1 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:46:50.611238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.612955 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'd6d495c1-980b-4b00-8770-6f4be830077b'} Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:50.613849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.615342 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.617008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:50.617008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ca807874-4ac8-4a8c-8bfd-727ffd9eedf7 tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 404 len: 111 microversion: 2.1 time: 0.030925 Jun 16 00:46:50.617008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 505/1006] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:46:50 2022] DELETE /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:46:50.621517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:46:50.622157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] [instance: d6d495c1-980b-4b00-8770-6f4be830077b] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:46:50.629327 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:50.629774 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:50.630520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:46:50.630954 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:46:50.644328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] HTTP exception thrown: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Request method failure captured: Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b HTTP/1.1 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqnx7S_uHZF7uwGVxHL-SW-qf8g0hPD11YDGT8rV8VtjZCnLVs8z_zAINsJnEub1Jk2qEUn6QjFaw9lvqXmmfGoxu4kdTTHavH4HibBJkty2L4CP3bJGQVLVUa-w6KcbYRjdbJJx4V8FWeIDORcI_HQy7iLinawp8wPc6qGHbxNvRwXY Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:46:50.645857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f8eb9ad6ea03410f9956bbabeddcd5b2"}]}] Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: f8eb9ad6ea03410f9956bbabeddcd5b2 Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-AttachVolumeTestJSON-215219749 Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: b3e4c68725cb4a9ea9024c3205dd5588 Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-AttachVolumeTestJSON-215219749-project Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.647494 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': 'd6d495c1-980b-4b00-8770-6f4be830077b'} Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:46:50.648487 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. Jun 16 00:46:50.649993 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:46:50.652294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] Returning 404 to user: Instance d6d495c1-980b-4b00-8770-6f4be830077b could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:46:50.652294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-56ea8685-a8af-44c8-9ba3-23e468815c9a tempest-AttachVolumeTestJSON-215219749 tempest-AttachVolumeTestJSON-215219749-project] 10.222.0.20 "GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b" status: 404 len: 111 microversion: 2.1 time: 0.029902 Jun 16 00:46:50.652294 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 502/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:46:50 2022] GET /compute/v2.1/servers/d6d495c1-980b-4b00-8770-6f4be830077b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:07.598229 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1806155866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-530055099", "security_groups": [{"name": "tempest-secgroup-smoke-298912126"}], "block_device_mapping_v2": [{"uuid": "c2ad8466-b1d5-4181-b8e3-9671b6539a54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "edd9d18b-1d6c-4052-b07a-8baf4adc8bec"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:07.607069 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:07.712632 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] validate_networks() for [('edd9d18b-1d6c-4052-b07a-8baf4adc8bec', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:47:08.374067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:47:08.374518 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:47:08.374986 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:47:08.375391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:47:08.375847 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:47:08.384502 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:08.388074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:08.388074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:08.388074 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:08.402977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:47:08.406909 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Getting quotas for user 517928d85b764c089c6dd5b2d088639c and project 3a122fcfab7f418baf78d7b742fa20db. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:47:08.464120 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:47:08.466217 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2ad8466-b1d5-4181-b8e3-9671b6539a54',volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:47:08.776847 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-06a27663-1a79-46f2-8122-59d88434e261 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.183162 Jun 16 00:47:08.777537 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 506/1008] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:47:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:47:08.788780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-7c02bb21-5a05-4fb4-9bf1-77c30bd6a79b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:08.789395 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-7c02bb21-5a05-4fb4-9bf1-77c30bd6a79b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:08.850920 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-7c02bb21-5a05-4fb4-9bf1-77c30bd6a79b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:08.858433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-7c02bb21-5a05-4fb4-9bf1-77c30bd6a79b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1094 microversion: 2.1 time: 0.073977 Jun 16 00:47:08.860088 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 503/1009] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:08 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:09.876489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:09.877119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:09.883429 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:09.883879 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:09.884680 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:09.885118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:09.946676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:09.955212 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c918b961-1abb-4b35-9a5a-2f78214fd807 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1144 microversion: 2.1 time: 0.083722 Jun 16 00:47:09.955765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 507/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:09 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:10.971732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:10.972436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:10.980554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:10.983004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:10.983004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:10.983004 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:11.050658 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:11.063854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b57a7091-2f42-42f1-aa19-67e481295317 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1210 microversion: 2.1 time: 0.095351 Jun 16 00:47:11.064718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 504/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:10 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:47:12.086092 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:12.086701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:12.095105 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:12.099237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:12.099237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:12.099237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:12.267600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:12.275563 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-5d66ee22-f65c-41ef-bdc2-5580fa9c83c1 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1277 microversion: 2.1 time: 0.193773 Jun 16 00:47:12.276670 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 508/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:12 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:47:12.482500 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-578a55bd-9ae5-411a-8438-ccb17a4b35b4 req-6f1d0e62-d5da-457a-9e4f-7838c5bd37cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ca4dcb-076c-452d-ab6a-dec4242c6d6f", "tag": "fb0d924d-2464-4401-827f-d9b8de88d21b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:12.492884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-578a55bd-9ae5-411a-8438-ccb17a4b35b4 req-6f1d0e62-d5da-457a-9e4f-7838c5bd37cf service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:12.493342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-578a55bd-9ae5-411a-8438-ccb17a4b35b4 req-6f1d0e62-d5da-457a-9e4f-7838c5bd37cf service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:12.505284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-578a55bd-9ae5-411a-8438-ccb17a4b35b4 req-6f1d0e62-d5da-457a-9e4f-7838c5bd37cf service nova] Creating event network-changed:fb0d924d-2464-4401-827f-d9b8de88d21b for instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f on hv-cinder-80382 Jun 16 00:47:12.510875 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-578a55bd-9ae5-411a-8438-ccb17a4b35b4 req-6f1d0e62-d5da-457a-9e4f-7838c5bd37cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045826 Jun 16 00:47:12.511374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 505/1013] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:13.292769 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:13.297852 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:13.299942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:13.300398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:13.301206 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:13.301646 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:13.436119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:13.443541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-162ef21b-de2c-466a-884f-6f41448d3a01 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.154681 Jun 16 00:47:13.444098 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 509/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:13 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:14.465158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:14.465883 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:14.471923 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:14.472369 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:14.473353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:14.473862 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:14.614447 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:14.623428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f75b5af7-445f-4ce5-bac8-cc23a2ab5092 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.162906 Jun 16 00:47:14.624160 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 506/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:14 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:15.639816 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:15.640427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:15.646953 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:15.647402 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:15.648171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:15.648639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:15.778714 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:15.786197 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-903f2451-90ea-4550-ab36-acaa523c8336 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.150699 Jun 16 00:47:15.786728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 510/1016] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:15 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:16.806346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:16.807189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:16.813620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:16.814081 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:16.814837 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:16.815281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:16.951218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:16.958604 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-66ec72f3-63d4-4881-88fb-3135038c1b91 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.156076 Jun 16 00:47:16.959155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 507/1017] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:16 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:17.975970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:17.976547 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:17.983664 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:17.984119 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:17.984934 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:17.985381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:18.116361 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:18.123797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3556ec4d-9a14-492a-b662-d252b47017fc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.151769 Jun 16 00:47:18.126524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 511/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:17 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:19.140211 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:19.140847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:19.143436 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:19.148189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:19.148680 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:19.149433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:19.149870 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:19.276408 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:19.283969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9ebd9f55-983f-4c94-a483-438277226cce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.147574 Jun 16 00:47:19.284535 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 508/1019] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:19 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:20.300595 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:20.301202 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:20.303088 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:20.303729 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:20.309305 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:20.309751 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:20.310510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:20.310940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:20.444255 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:20.453635 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3d838e87-414f-4c24-8ce7-62153e211a70 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.156974 Jun 16 00:47:20.454200 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 512/1020] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:20 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:21.470473 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:21.471111 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:21.476982 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:21.477440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:21.479377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:21.479377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:21.610144 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:21.622549 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f98ec314-cd46-4e14-9c17-c3ac68793cc5 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.151358 Jun 16 00:47:21.622549 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 509/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:21 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:22.634705 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:22.635324 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:22.642419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:22.642863 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:22.643610 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:22.644039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:22.772908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:22.780378 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-faa9f563-c027-4f2b-a9a5-87e2f2cf8716 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.149796 Jun 16 00:47:22.780983 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 513/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:22 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:23.957346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:23.957953 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:23.963863 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:23.964311 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:23.965102 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:23.965536 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:24.092618 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:24.100643 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-01d9f7db-23d1-4143-94b8-aa1022949e7e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.307578 Jun 16 00:47:24.101307 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 510/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:23 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:24.725940 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-9124ad0c-bcf3-4fc3-ad19-e5d20466dfaf req-5360817d-fa5b-462b-9d47-50c98c0b9788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ca4dcb-076c-452d-ab6a-dec4242c6d6f", "name": "network-vif-plugged", "status": "completed", "tag": "fb0d924d-2464-4401-827f-d9b8de88d21b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:24.734473 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-9124ad0c-bcf3-4fc3-ad19-e5d20466dfaf req-5360817d-fa5b-462b-9d47-50c98c0b9788 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:24.736023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-9124ad0c-bcf3-4fc3-ad19-e5d20466dfaf req-5360817d-fa5b-462b-9d47-50c98c0b9788 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:24.747260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-9124ad0c-bcf3-4fc3-ad19-e5d20466dfaf req-5360817d-fa5b-462b-9d47-50c98c0b9788 service nova] Creating event network-vif-plugged:fb0d924d-2464-4401-827f-d9b8de88d21b for instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f on hv-cinder-80382 Jun 16 00:47:24.753748 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-9124ad0c-bcf3-4fc3-ad19-e5d20466dfaf req-5360817d-fa5b-462b-9d47-50c98c0b9788 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093864 Jun 16 00:47:24.754472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 514/1024] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:25.119122 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:25.119821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:25.126921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:25.127368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:25.128390 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:25.128853 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:25.323825 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:25.331751 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-92c61f07-c417-4629-8f9b-4af2d7b08896 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.217775 Jun 16 00:47:25.332300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 511/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:25 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:26.350389 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:26.351084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:26.357401 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:26.357856 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:26.358640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:26.359077 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:26.492551 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:26.501102 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2392a4e3-e650-4284-a2ab-7357ee330392 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1265 microversion: 2.1 time: 0.154672 Jun 16 00:47:26.501681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 515/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:26 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:27.517690 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:27.518285 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:27.524341 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:27.524822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:27.525725 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:27.526164 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:27.663767 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:27.671180 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b1ad0e15-fb0a-498b-a61a-9859445d2a68 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1452 microversion: 2.1 time: 0.157521 Jun 16 00:47:27.671733 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 512/1027] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:27 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:27.690644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:27.690644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:27.694820 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:27.695273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:27.696034 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:27.696472 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:27.826972 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:27.834589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-ba279de4-9be6-4a03-b5ec-bde417bd87c3 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1452 microversion: 2.1 time: 0.150395 Jun 16 00:47:27.835239 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 516/1028] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:27 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:29.922816 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-7ee3ff39-51c3-4b15-a593-1547ee240038 req-e85fd99d-c97e-47f4-895a-ec28c62cce6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ca4dcb-076c-452d-ab6a-dec4242c6d6f", "tag": "fb0d924d-2464-4401-827f-d9b8de88d21b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:29.931362 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-7ee3ff39-51c3-4b15-a593-1547ee240038 req-e85fd99d-c97e-47f4-895a-ec28c62cce6e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:29.931818 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-7ee3ff39-51c3-4b15-a593-1547ee240038 req-e85fd99d-c97e-47f4-895a-ec28c62cce6e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:29.943613 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-7ee3ff39-51c3-4b15-a593-1547ee240038 req-e85fd99d-c97e-47f4-895a-ec28c62cce6e service nova] Creating event network-changed:fb0d924d-2464-4401-827f-d9b8de88d21b for instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f on hv-cinder-80382 Jun 16 00:47:29.949199 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-7ee3ff39-51c3-4b15-a593-1547ee240038 req-e85fd99d-c97e-47f4-895a-ec28c62cce6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191731 Jun 16 00:47:29.949959 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 513/1029] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:35.336893 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1809124794", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "networks": [{"uuid": "61f6e394-6573-4b4c-ae93-70c44bece667"}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:35.389278 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] validate_networks() for [('61f6e394-6573-4b4c-ae93-70c44bece667', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:47:35.731944 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:47:35.732357 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:47:35.732876 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:47:35.733286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:47:35.733697 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:47:35.742732 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:35.743183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:35.743980 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:35.744418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:35.761315 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Getting quotas for project a32b5211fe814671baad0e5816e4b949. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:47:35.765169 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Getting quotas for user 372c815f955b4645bcc2c3f3ed4eb828 and project a32b5211fe814671baad0e5816e4b949. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:47:35.776398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:47:35.778689 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:47:35.917075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7bf13174-a4e6-48cd-97c0-97340a2a32fc tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584301 Jun 16 00:47:35.917708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 517/1030] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:47:35.928435 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-cde06e2e-4d2a-4a80-a51a-fbab4c01f797 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:35.929181 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-cde06e2e-4d2a-4a80-a51a-fbab4c01f797 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:35.983128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-cde06e2e-4d2a-4a80-a51a-fbab4c01f797 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:35.989847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-cde06e2e-4d2a-4a80-a51a-fbab4c01f797 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1214 microversion: 2.1 time: 0.065740 Jun 16 00:47:35.993084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 514/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:35 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:47:37.007589 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:37.009524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:37.018557 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:37.019016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:37.019793 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:37.020231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:37.080075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:37.087469 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-1d8e98c7-f30b-4e43-8af1-1ab0e1d5a725 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1218 microversion: 2.1 time: 0.084445 Jun 16 00:47:37.088022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 518/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:37 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:38.105365 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:38.106115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:38.114277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:38.114724 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:38.115479 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:38.115911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:38.207968 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:38.219918 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f971499f-5907-41c2-8d66-d76ea45bbd2d tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1274 microversion: 2.1 time: 0.118559 Jun 16 00:47:38.220885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 515/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:38 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:39.237490 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:39.238815 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:39.241259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:39.246023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:39.246474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:39.247272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:39.247708 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:39.251632 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=67 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:39.383003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:39.391151 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f3e21f1e-de5f-4c06-9aeb-93858d34fae9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.157465 Jun 16 00:47:39.391826 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 519/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:39 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:39.880315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-82e2ce94-6417-4779-b92c-592358a7f0aa req-185d52b6-d1ad-4f2b-8278-3b05fe89ab96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4", "tag": "9bce2f12-f315-4b2b-8ad8-a0bb21371db7"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:39.885736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=34 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:39.889587 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-82e2ce94-6417-4779-b92c-592358a7f0aa req-185d52b6-d1ad-4f2b-8278-3b05fe89ab96 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:39.890041 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-82e2ce94-6417-4779-b92c-592358a7f0aa req-185d52b6-d1ad-4f2b-8278-3b05fe89ab96 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:39.893994 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=62 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:39.901662 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-82e2ce94-6417-4779-b92c-592358a7f0aa req-185d52b6-d1ad-4f2b-8278-3b05fe89ab96 service nova] Creating event network-changed:9bce2f12-f315-4b2b-8ad8-a0bb21371db7 for instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 on hv-cinder-80382 Jun 16 00:47:39.906430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-82e2ce94-6417-4779-b92c-592358a7f0aa req-185d52b6-d1ad-4f2b-8278-3b05fe89ab96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030127 Jun 16 00:47:39.907024 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 516/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:47:40.408789 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:40.409634 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:40.417030 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:40.417484 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:40.418252 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:40.418692 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:40.546839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:40.554655 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cf8d9e9f-f051-45c4-8213-5956c06d728b tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.150013 Jun 16 00:47:40.555320 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 520/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:40 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:41.573691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:41.574382 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:41.581620 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:41.582072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:41.582835 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:41.583272 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:41.712851 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:41.720319 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-22fd7339-63b9-419c-a1b6-3d78d183c4c2 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.151924 Jun 16 00:47:41.720918 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 517/1037] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:41 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:42.737415 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:42.738075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:42.744778 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:42.745235 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:42.746006 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:42.746445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:42.875678 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:42.885171 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-cb11221e-0665-4dc0-9010-ad82bbee5628 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.151706 Jun 16 00:47:42.886177 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 521/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:42 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:43.901979 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:43.902517 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:43.909027 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:43.909480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:43.910839 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:43.911271 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:44.035901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:44.043235 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3b4b0059-c8c6-436c-84a0-0abfd37cda86 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.145186 Jun 16 00:47:44.043782 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 518/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:43 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:44.789572 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-d1e1a56f-c8c9-4f4e-b1d8-413309e124fc req-ac02f7df-015d-4c1f-b1a5-063496f6860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4", "name": "network-vif-plugged", "status": "completed", "tag": "9bce2f12-f315-4b2b-8ad8-a0bb21371db7"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:44.799244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-d1e1a56f-c8c9-4f4e-b1d8-413309e124fc req-ac02f7df-015d-4c1f-b1a5-063496f6860f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:44.799244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-d1e1a56f-c8c9-4f4e-b1d8-413309e124fc req-ac02f7df-015d-4c1f-b1a5-063496f6860f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:44.809603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-d1e1a56f-c8c9-4f4e-b1d8-413309e124fc req-ac02f7df-015d-4c1f-b1a5-063496f6860f service nova] Creating event network-vif-plugged:9bce2f12-f315-4b2b-8ad8-a0bb21371db7 for instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 on hv-cinder-80382 Jun 16 00:47:44.814522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-d1e1a56f-c8c9-4f4e-b1d8-413309e124fc req-ac02f7df-015d-4c1f-b1a5-063496f6860f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029319 Jun 16 00:47:44.815116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 522/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:45.059471 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:45.060118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:45.067277 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:45.068624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:45.068624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:45.069083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:45.520301 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:45.527828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d5c56095-9040-4d27-b538-d2d41022edad tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.472408 Jun 16 00:47:45.528392 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 519/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:45 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:46.541448 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:46.542231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:46.546695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:46.547485 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:46.553753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:46.554285 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:46.555048 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:46.555478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:46.689926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:46.697978 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-033f3152-18c3-4df6-b464-e622f976e24c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1314 microversion: 2.1 time: 0.157495 Jun 16 00:47:46.702071 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 523/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:46 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:47.715251 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:47.715783 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:47.717735 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:47.723684 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:47.724133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:47.724916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:47.725353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:47.848990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:47.856351 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b04bfd1d-cd37-41f2-9115-b3e3acda8908 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1498 microversion: 2.1 time: 0.145064 Jun 16 00:47:47.856949 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 520/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:47 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:48.763284 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:48.763763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:48.770258 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:48.770704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:48.771578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:48.772014 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:48.796577 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:47:49.048660 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c595cd8d-6d15-4575-bfa0-855dbbcc76d9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 204 len: 0 microversion: 2.1 time: 0.288750 Jun 16 00:47:49.049192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 524/1044] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:47:48 2022] DELETE /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:47:49.057309 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:49.061157 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:49.064514 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:49.065001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:49.065772 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:49.066215 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:49.190917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:49.198388 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-65c928d5-e7b0-45f8-982a-30a1a3b17ea4 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1504 microversion: 2.1 time: 0.144960 Jun 16 00:47:49.198956 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 521/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:49 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:50.217667 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:50.218363 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:50.225409 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:50.225868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:50.226634 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:50.227073 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:50.358900 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:50.366846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0b5babfd-e8e4-4c0c-bc87-ccdf2bbe2cd1 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1504 microversion: 2.1 time: 0.153502 Jun 16 00:47:50.367402 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 525/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:50 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:51.383861 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:51.384428 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:51.390520 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:51.390970 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:51.391737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:51.392171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:51.498650 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:51.506833 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ac2c8cfb-8926-4c13-b963-2ead2b3f1e9a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1462 microversion: 2.1 time: 0.126844 Jun 16 00:47:51.507599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 522/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:51 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1462 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:51.540782 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-0d573b44-d7b6-4d47-94ad-96b8c7cdb99b req-6bb8077a-fb8e-4bf9-a446-794d878c2f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4", "name": "network-vif-deleted", "tag": "9bce2f12-f315-4b2b-8ad8-a0bb21371db7"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:51.549345 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0d573b44-d7b6-4d47-94ad-96b8c7cdb99b req-6bb8077a-fb8e-4bf9-a446-794d878c2f59 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:51.549781 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-0d573b44-d7b6-4d47-94ad-96b8c7cdb99b req-6bb8077a-fb8e-4bf9-a446-794d878c2f59 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:51.561250 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-0d573b44-d7b6-4d47-94ad-96b8c7cdb99b req-6bb8077a-fb8e-4bf9-a446-794d878c2f59 service nova] Creating event network-vif-deleted:9bce2f12-f315-4b2b-8ad8-a0bb21371db7 for instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 on hv-cinder-80382 Jun 16 00:47:51.566530 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-0d573b44-d7b6-4d47-94ad-96b8c7cdb99b req-6bb8077a-fb8e-4bf9-a446-794d878c2f59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029315 Jun 16 00:47:51.567111 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 526/1048] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:52.523732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:52.524337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:52.530922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:52.531371 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:52.532128 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:52.532623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:52.569334 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:52.569780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:52.570226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lazy-loading 'fault' on Instance uuid f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:47:52.616107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:52.624057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-303ee574-1cd9-42a1-84a3-6d84a018a0a3 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 200 len: 1304 microversion: 2.1 time: 0.104789 Jun 16 00:47:52.624815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 523/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:52 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:53.642545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:53.643261 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:53.650458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:53.650933 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:53.651688 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:53.652147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:53.668286 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] HTTP exception thrown: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Request method failure captured: Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 HTTP/1.1 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqn2lrQwBlOezZBP_7Q8uq1-3SSXLQBTxoKgMa6ATpw_s6bOZZWBijSKAQ2GbPizRzgi4r_xLIJJGwWIZpnHwCYJ2D5CThSL1uYjXPgkEqZhHNmtqNcBUrvanxTuit30dFCy0lgddGeFvdfRCuN_xVmvrDByXRIMABd1wPf9HOooRTTA Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: a32b5211fe814671baad0e5816e4b949 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesActionsTest-853388101 Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:47:53.671023 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a32b5211fe814671baad0e5816e4b949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a32b5211fe814671baad0e5816e4b949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a32b5211fe814671baad0e5816e4b949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a32b5211fe814671baad0e5816e4b949"}]}] Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesActionsTest-853388101 Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: a32b5211fe814671baad0e5816e4b949 Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesActionsTest-853388101 Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesActionsTest-853388101-project Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 372c815f955b4645bcc2c3f3ed4eb828 Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesActionsTest-853388101-project Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. Jun 16 00:47:53.672638 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4'} Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:47:53.673526 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. Jun 16 00:47:53.674873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:47:53.676080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Returning 404 to user: Instance f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:47:53.676080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-268801b1-9844-46eb-a0e4-f0da1a238daf tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4" status: 404 len: 111 microversion: 2.1 time: 0.032972 Jun 16 00:47:53.676080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 527/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:53 2022] GET /compute/v2.1/servers/f6baae9a-a6ae-4312-9aa7-ae9df1f6e8d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:47:53.720486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-457078981", "imageRef": "63176af0-ad55-4a5d-b58a-34d9ec80927b", "flavorRef": "452", "networks": [{"uuid": "61f6e394-6573-4b4c-ae93-70c44bece667"}]}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:53.771433 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.network.neutron [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] validate_networks() for [('61f6e394-6573-4b4c-ae93-70c44bece667', None, None, None, None, None)] {{(pid=124722) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:47:54.176489 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Flavor limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:47:54.176987 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Image limits 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:47:54.178149 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Flavor pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:47:54.178571 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Image pref 0:0:0 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:47:54.179166 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.virt.hardware [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124722) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:47:54.188087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:54.188545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:54.189380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:54.189812 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:54.206922 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Getting quotas for project a32b5211fe814671baad0e5816e4b949. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:47:54.211546 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Getting quotas for user 372c815f955b4645bcc2c3f3ed4eb828 and project a32b5211fe814671baad0e5816e4b949. Resources: {'instances', 'cores', 'ram'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:47:54.222916 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Going to run 1 instances... {{(pid=124722) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:47:54.225212 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='63176af0-ad55-4a5d-b58a-34d9ec80927b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124722) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:47:54.319548 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-10a096d1-4502-4e22-a4c7-fc1f9a536280 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602942 Jun 16 00:47:54.320167 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 524/1051] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 00:47:54.330285 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-7b4a3425-5c58-499f-874f-505ba3834244 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:54.331143 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-7b4a3425-5c58-499f-874f-505ba3834244 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:54.384431 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-7b4a3425-5c58-499f-874f-505ba3834244 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:54.393546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-7b4a3425-5c58-499f-874f-505ba3834244 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1213 microversion: 2.1 time: 0.067303 Jun 16 00:47:54.394124 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 528/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:54 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:55.412545 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:55.413169 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:55.420506 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:55.421132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:55.421914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:55.422374 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:55.483926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:55.491418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-010ad12a-2328-4955-a568-e3d5deade21f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1209 microversion: 2.1 time: 0.084017 Jun 16 00:47:55.492775 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 525/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:55 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:56.512436 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:56.513086 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:56.520330 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:56.520818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:56.521600 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:56.523040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:56.784582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:56.791969 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-806d3ef4-969a-4b9c-9bf2-09696aa58a01 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1271 microversion: 2.1 time: 0.283414 Jun 16 00:47:56.794867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 529/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:56 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:57.749434 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-0fdb5a52-b4be-43c9-94c5-a68e5b759ee7 req-b8f240d2-bec4-4315-ae77-8c25e942cdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "697236e9-d566-4044-9520-e28cef18f4fe", "tag": "35b9cc51-1147-4e95-b4a6-ceba8606d941"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:47:57.760580 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-0fdb5a52-b4be-43c9-94c5-a68e5b759ee7 req-b8f240d2-bec4-4315-ae77-8c25e942cdb8 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:57.761042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-0fdb5a52-b4be-43c9-94c5-a68e5b759ee7 req-b8f240d2-bec4-4315-ae77-8c25e942cdb8 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:57.772098 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-0fdb5a52-b4be-43c9-94c5-a68e5b759ee7 req-b8f240d2-bec4-4315-ae77-8c25e942cdb8 service nova] Creating event network-changed:35b9cc51-1147-4e95-b4a6-ceba8606d941 for instance 697236e9-d566-4044-9520-e28cef18f4fe on hv-cinder-80382 Jun 16 00:47:57.777143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-0fdb5a52-b4be-43c9-94c5-a68e5b759ee7 req-b8f240d2-bec4-4315-ae77-8c25e942cdb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032731 Jun 16 00:47:57.778007 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 526/1055] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:47:57.809763 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:57.810369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:57.817309 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:57.817754 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:57.818539 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:57.819510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:57.954545 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:57.964913 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8ed46df2-2512-4cd8-8a68-720ea4f8628a tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.159132 Jun 16 00:47:57.965489 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 530/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:57 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:47:58.982076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:47:58.982773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:47:58.989537 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:58.989990 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:58.991276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:47:58.991712 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:47:59.121200 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:47:59.128560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d9623dbe-d022-4580-97c6-ac202be0024e tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.150674 Jun 16 00:47:59.129118 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 527/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:47:58 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:00.145868 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:00.146478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:00.153154 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:00.153608 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:00.154364 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:00.154799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:00.282179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:00.292676 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-03d37757-5e0f-413f-bb52-89792a1879e9 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.150734 Jun 16 00:48:00.293241 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 531/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:00 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:01.309969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:01.310575 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:01.317016 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:01.317458 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:01.318209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:01.319248 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:01.444087 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:01.451720 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-8a932959-7dae-4259-b029-ddd29881f2be tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.145655 Jun 16 00:48:01.452270 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 528/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:01 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:02.468817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:02.469351 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:02.475899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:02.476348 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:02.477141 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:02.477581 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:02.603308 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:02.610777 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-83b7ac0f-0d4d-4832-b96e-625292454c57 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.146015 Jun 16 00:48:02.611337 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 532/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:02 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:02.860754 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-83f2120b-be2b-442d-9573-2443aa78fdc7 req-d0dc6a45-925c-481b-8bf8-a1ff2efc70bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697236e9-d566-4044-9520-e28cef18f4fe", "name": "network-vif-plugged", "status": "completed", "tag": "35b9cc51-1147-4e95-b4a6-ceba8606d941"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:48:02.869811 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-83f2120b-be2b-442d-9573-2443aa78fdc7 req-d0dc6a45-925c-481b-8bf8-a1ff2efc70bb service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:02.870259 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-83f2120b-be2b-442d-9573-2443aa78fdc7 req-d0dc6a45-925c-481b-8bf8-a1ff2efc70bb service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:02.880765 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-83f2120b-be2b-442d-9573-2443aa78fdc7 req-d0dc6a45-925c-481b-8bf8-a1ff2efc70bb service nova] Creating event network-vif-plugged:35b9cc51-1147-4e95-b4a6-ceba8606d941 for instance 697236e9-d566-4044-9520-e28cef18f4fe on hv-cinder-80382 Jun 16 00:48:02.889226 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-83f2120b-be2b-442d-9573-2443aa78fdc7 req-d0dc6a45-925c-481b-8bf8-a1ff2efc70bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jun 16 00:48:02.890094 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 529/1061] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:48:03.627701 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:03.628327 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:03.635524 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:03.635970 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:03.636760 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:03.637196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:03.767565 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:03.775495 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2d88afbb-c391-45fa-98fc-c341f9edf614 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.151772 Jun 16 00:48:03.776058 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 533/1062] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:03 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:04.789468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=2 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:04.790313 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=6 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:04.794468 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:04.795192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:04.801622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:04.802082 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:04.802843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:04.803281 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:04.940797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:04.948845 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d23eceb9-fe67-4479-80db-58d8cab2241c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1313 microversion: 2.1 time: 0.160806 Jun 16 00:48:04.949399 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 530/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:04 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:05.966068 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:05.966613 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:05.968558 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:05.973854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:05.981332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:05.981332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:05.981332 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:06.104015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:06.111498 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-e4e78ecb-b540-46c7-9d6d-c7e61eefb663 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1497 microversion: 2.1 time: 0.149334 Jun 16 00:48:06.112063 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 534/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:05 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:06.997800 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:06.998304 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:07.004720 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:07.005169 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:07.005921 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:07.006357 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:07.031490 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:48:07.287761 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d30b77da-35e9-4133-bd75-b8a0d3a51d0f tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "DELETE /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 204 len: 0 microversion: 2.1 time: 0.293444 Jun 16 00:48:07.288355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 531/1065] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:48:06 2022] DELETE /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:48:07.296640 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:07.301728 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:07.303788 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:07.304249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:07.305039 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:07.305497 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:07.433381 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:07.440798 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dde558a5-4916-4bcf-ade2-1a6b5ec7fa61 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1503 microversion: 2.1 time: 0.147937 Jun 16 00:48:07.441355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 535/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:07 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:08.459218 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:08.459847 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:08.466971 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:08.467425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:08.468190 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:08.468660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:08.595076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:08.602640 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f7fc648e-697f-4632-9180-18a01386b45c tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1503 microversion: 2.1 time: 0.147763 Jun 16 00:48:08.603203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 532/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:08 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:09.370061 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-4cc3e717-ce99-479c-b3ed-81cced07baa5 req-df931d7c-2555-4276-a061-fe69ef4cd179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "697236e9-d566-4044-9520-e28cef18f4fe", "name": "network-vif-deleted", "tag": "35b9cc51-1147-4e95-b4a6-ceba8606d941"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:48:09.378543 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-4cc3e717-ce99-479c-b3ed-81cced07baa5 req-df931d7c-2555-4276-a061-fe69ef4cd179 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:09.385681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-4cc3e717-ce99-479c-b3ed-81cced07baa5 req-df931d7c-2555-4276-a061-fe69ef4cd179 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:09.385681 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:09.389883 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-4cc3e717-ce99-479c-b3ed-81cced07baa5 req-df931d7c-2555-4276-a061-fe69ef4cd179 service nova] Creating event network-vif-deleted:35b9cc51-1147-4e95-b4a6-ceba8606d941 for instance 697236e9-d566-4044-9520-e28cef18f4fe on hv-cinder-80382 Jun 16 00:48:09.394916 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-4cc3e717-ce99-479c-b3ed-81cced07baa5 req-df931d7c-2555-4276-a061-fe69ef4cd179 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 Jun 16 00:48:09.395483 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 536/1068] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:48:09.619273 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:09.619917 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:09.626427 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:09.626890 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:09.627648 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:09.628090 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:09.642730 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:09.659230 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:09.659687 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:09.660142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lazy-loading 'fault' on Instance uuid 697236e9-d566-4044-9520-e28cef18f4fe {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:48:09.700425 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '372c815f955b4645bcc2c3f3ed4eb828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32b5211fe814671baad0e5816e4b949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:09.707843 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4ddbc8a8-40d9-4484-9f27-0f7ce1d85c02 tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 200 len: 1303 microversion: 2.1 time: 0.092437 Jun 16 00:48:09.708404 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 533/1069] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:09 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:48:10.726358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:10.727059 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] [instance: 697236e9-d566-4044-9520-e28cef18f4fe] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:10.729325 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:10.734532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:10.734984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:10.735753 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:10.736191 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:10.749028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] HTTP exception thrown: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Request method failure captured: Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe HTTP/1.1 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqn2lrQwBlOezZBP_7Q8uq1-3SSXLQBTxoKgMa6ATpw_s6bOZZWBijSKAQ2GbPizRzgi4r_xLIJJGwWIZpnHwCYJ2D5CThSL1uYjXPgkEqZhHNmtqNcBUrvanxTuit30dFCy0lgddGeFvdfRCuN_xVmvrDByXRIMABd1wPf9HOooRTTA Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: a32b5211fe814671baad0e5816e4b949 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-VolumesActionsTest-853388101 Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:48:10.750617 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a32b5211fe814671baad0e5816e4b949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a32b5211fe814671baad0e5816e4b949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a32b5211fe814671baad0e5816e4b949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a32b5211fe814671baad0e5816e4b949"}]}] Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-VolumesActionsTest-853388101 Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: a32b5211fe814671baad0e5816e4b949 Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-VolumesActionsTest-853388101 Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-VolumesActionsTest-853388101-project Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 372c815f955b4645bcc2c3f3ed4eb828 Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-VolumesActionsTest-853388101-project Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. Jun 16 00:48:10.752355 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '697236e9-d566-4044-9520-e28cef18f4fe'} Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:48:10.753398 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. Jun 16 00:48:10.755036 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:48:10.756541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] Returning 404 to user: Instance 697236e9-d566-4044-9520-e28cef18f4fe could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:48:10.756541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-692a848d-ba73-43a8-b28e-bc4fc5bc59ed tempest-VolumesActionsTest-853388101 tempest-VolumesActionsTest-853388101-project] 10.222.0.20 "GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe" status: 404 len: 111 microversion: 2.1 time: 0.030456 Jun 16 00:48:10.756541 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 537/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:10 2022] GET /compute/v2.1/servers/697236e9-d566-4044-9520-e28cef18f4fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:48:20.305804 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:48:20.306644 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:48:49.261946 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:48:49.430286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Action: 'create', calling method: .version_select at 0x7f2a7b3b8ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1125781319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjmL5Evf1weGDG+LRcep3nWDWMg0FBDt0r7ZycWzIBSaINJlgBL67XE31gYpCjv8gkWUeHObjuXNA7oOU1Z6a7A0hNTgq8HESATJyZ1xKVIEn5b7btb8R/yiEMCNlclVw=="}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:48:49.444504 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Getting quotas for project 5e9d772a2cb14bbbaaa2dcaf5d730f6e. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:48:49.448266 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.quota [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Getting quotas for user d0aeb18780734fecbbd6bc8f9202f84d and project 5e9d772a2cb14bbbaaa2dcaf5d730f6e. Resources: {'key_pairs'} {{(pid=124722) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:48:49.460115 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [5ea7b7b2-a30a-42a7-81ef-3d641e446306] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 00:48:50.469462 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [5ea7b7b2-a30a-42a7-81ef-3d641e446306] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37472. Jun 16 00:48:50.557820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9477af04-8adf-404f-9bed-c751f06282b6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.301083 Jun 16 00:48:50.558431 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 534/1071] 10.222.0.20 () {60 vars in 1158 bytes} [Thu Jun 16 00:48:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:48:57.960192 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-34af2fe1-db33-4ad6-88a0-a38c72c6b3c7 req-70a1a05d-4ef9-4b8e-9e31-8f1afb17fb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ca4dcb-076c-452d-ab6a-dec4242c6d6f", "tag": "fb0d924d-2464-4401-827f-d9b8de88d21b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:48:57.966817 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:57.967426 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:57.979146 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:57.979598 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:57.980373 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:57.980903 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:57.985599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-34af2fe1-db33-4ad6-88a0-a38c72c6b3c7 req-70a1a05d-4ef9-4b8e-9e31-8f1afb17fb8c service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:57.986253 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-34af2fe1-db33-4ad6-88a0-a38c72c6b3c7 req-70a1a05d-4ef9-4b8e-9e31-8f1afb17fb8c service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:57.998911 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-34af2fe1-db33-4ad6-88a0-a38c72c6b3c7 req-70a1a05d-4ef9-4b8e-9e31-8f1afb17fb8c service nova] Creating event network-changed:fb0d924d-2464-4401-827f-d9b8de88d21b for instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f on hv-cinder-80382 Jun 16 00:48:58.007067 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-34af2fe1-db33-4ad6-88a0-a38c72c6b3c7 req-70a1a05d-4ef9-4b8e-9e31-8f1afb17fb8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050914 Jun 16 00:48:58.007602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 535/1072] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:48:58.013010 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Going to try to terminate instance {{(pid=124721) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:48:58.378438 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-55d940f0-a6b9-4f81-89ce-6a7452a0cd66 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 204 len: 0 microversion: 2.1 time: 0.427056 Jun 16 00:48:58.379029 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 538/1073] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:48:57 2022] DELETE /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:48:58.387865 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:58.388721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:58.395107 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:58.395639 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:58.396480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:58.397012 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:58.534386 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:58.542482 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-18eea912-e2a6-41a1-b1af-6fd1f5fe0cbf tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1576 microversion: 2.1 time: 0.158838 Jun 16 00:48:58.543053 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 536/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:58 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:48:59.560566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:48:59.561478 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:48:59.568080 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:59.568552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:59.569360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:48:59.569751 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:48:59.719554 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:48:59.727214 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c87411e5-699d-4147-b0e9-c968dc22041b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1576 microversion: 2.1 time: 0.171553 Jun 16 00:48:59.727791 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 539/1075] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:48:59 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:00.698743 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-8d6c6e8f-e9c6-495c-814b-4a1be916d54e req-de161ef1-afeb-4225-b443-220efd011e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ca4dcb-076c-452d-ab6a-dec4242c6d6f", "name": "network-vif-deleted", "tag": "fb0d924d-2464-4401-827f-d9b8de88d21b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:00.703112 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:00.708820 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8d6c6e8f-e9c6-495c-814b-4a1be916d54e req-de161ef1-afeb-4225-b443-220efd011e97 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:00.709561 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-8d6c6e8f-e9c6-495c-814b-4a1be916d54e req-de161ef1-afeb-4225-b443-220efd011e97 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:00.723750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-8d6c6e8f-e9c6-495c-814b-4a1be916d54e req-de161ef1-afeb-4225-b443-220efd011e97 service nova] Creating event network-vif-deleted:fb0d924d-2464-4401-827f-d9b8de88d21b for instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f on hv-cinder-80382 Jun 16 00:49:00.728773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-8d6c6e8f-e9c6-495c-814b-4a1be916d54e req-de161ef1-afeb-4225-b443-220efd011e97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033769 Jun 16 00:49:00.729364 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 537/1076] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:49:00.745358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:00.746387 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:00.754359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:00.754821 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:00.755603 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:00.756044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:00.820850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:00.828730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-8a366af2-0adf-49b7-b76d-6a438ba0af09 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1391 microversion: 2.1 time: 0.087179 Jun 16 00:49:00.829287 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 540/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:00 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:01.847432 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:01.848133 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:01.854909 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:01.855361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:01.856114 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:01.856574 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:01.887717 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:01.888171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:01.888657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lazy-loading 'fault' on Instance uuid 65ca4dcb-076c-452d-ab6a-dec4242c6d6f {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:49:01.931678 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:01.945385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-00aa5615-13f1-476e-b83e-564b0ce6d773 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 200 len: 1230 microversion: 2.1 time: 0.101822 Jun 16 00:49:01.945385 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 538/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:01 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:02.968552 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:02.969507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: 65ca4dcb-076c-452d-ab6a-dec4242c6d6f] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:02.976065 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:02.976513 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:02.977307 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:02.977740 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:02.991683 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] HTTP exception thrown: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Request method failure captured: Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f HTTP/1.1 Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnxoO9ghD0N90Begoj2wLwpp6Dd8Pb00SM7fZ-mkM_BnRqb5qPuQ6euFtzESujJ6cQBkb1hdmKHsqaY5kDuoIBdM6w8fb6Usg93l3vjUPz2pkBfOubzrcCpXelnvdU1OypkiBpXaNoTlRZQjl17xeO4dkk47QNzOqTnWMRvEHDMo_fw Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:49:02.993445 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}] Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 517928d85b764c089c6dd5b2d088639c Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. Jun 16 00:49:02.995159 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': '65ca4dcb-076c-452d-ab6a-dec4242c6d6f'} Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:49:02.996067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. Jun 16 00:49:02.997463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:02.999125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Returning 404 to user: Instance 65ca4dcb-076c-452d-ab6a-dec4242c6d6f could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:49:02.999125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-083a17a4-967b-423c-8c19-20aecfdad5be tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f" status: 404 len: 111 microversion: 2.1 time: 0.031183 Jun 16 00:49:02.999125 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 541/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:02 2022] GET /compute/v2.1/servers/65ca4dcb-076c-452d-ab6a-dec4242c6d6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:49:06.293914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:06.294424 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:06.295685 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-89d437b5-9af9-4afb-a2e7-7696d1914a4a req-b277bc78-c9f8-42e5-8519-7e326ff6f2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c407165e-8822-4cbe-a4b4-cdd515e2c048", "tag": "04943923-128c-4497-8f50-577da86b34e2"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:06.301892 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:06.302439 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:06.303406 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:06.304150 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:06.317317 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-89d437b5-9af9-4afb-a2e7-7696d1914a4a req-b277bc78-c9f8-42e5-8519-7e326ff6f2c9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:06.317758 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-89d437b5-9af9-4afb-a2e7-7696d1914a4a req-b277bc78-c9f8-42e5-8519-7e326ff6f2c9 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:06.330884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:49:06.334522 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-89d437b5-9af9-4afb-a2e7-7696d1914a4a req-b277bc78-c9f8-42e5-8519-7e326ff6f2c9 service nova] Creating event network-changed:04943923-128c-4497-8f50-577da86b34e2 for instance c407165e-8822-4cbe-a4b4-cdd515e2c048 on hv-cinder-80382 Jun 16 00:49:06.338707 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-89d437b5-9af9-4afb-a2e7-7696d1914a4a req-b277bc78-c9f8-42e5-8519-7e326ff6f2c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046574 Jun 16 00:49:06.339965 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 542/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:49:06.570738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-39193fdd-de25-44bd-9dad-eff9e111508e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 204 len: 0 microversion: 2.1 time: 0.280650 Jun 16 00:49:06.571332 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 539/1081] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:49:06 2022] DELETE /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:49:06.580367 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:06.581107 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:06.587405 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:06.587848 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:06.588649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:06.589084 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:06.724260 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:06.731665 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-b98462bf-07d3-4883-b411-9e751e08cc00 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1578 microversion: 2.1 time: 0.155911 Jun 16 00:49:06.732238 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 543/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:06 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:07.749033 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:07.749736 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:07.756606 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:07.757060 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:07.757821 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:07.758256 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:07.919603 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:07.927188 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3cf46d9a-52ba-4ab6-857f-b2207ce1dbdb tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1578 microversion: 2.1 time: 0.182387 Jun 16 00:49:07.927744 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 540/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:07 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:08.306496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1775395588", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1125781319", "security_groups": [{"name": "tempest-secgroup-smoke-2001135803"}], "networks": [{"uuid": "9ed496a4-8fc1-4fe0-bc5e-ab3ca4863b50"}], "block_device_mapping_v2": [{"uuid": "6d1df40e-f104-41ba-8ba6-dec747a489a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:08.418001 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.network.neutron [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] validate_networks() for [('9ed496a4-8fc1-4fe0-bc5e-ab3ca4863b50', None, None, None, None, None)] {{(pid=124721) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 00:49:08.787046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-3847b31f-1633-485a-baf7-ceb9e3abb25a req-c422da30-7bc1-4468-a0d2-465949083f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c407165e-8822-4cbe-a4b4-cdd515e2c048", "name": "network-vif-deleted", "tag": "04943923-128c-4497-8f50-577da86b34e2"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:08.787984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Flavor limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 00:49:08.788622 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Image limits 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 00:49:08.789390 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Flavor pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 00:49:08.789850 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Image pref 0:0:0 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 00:49:08.790360 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.virt.hardware [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124721) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 00:49:08.795718 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3847b31f-1633-485a-baf7-ceb9e3abb25a req-c422da30-7bc1-4468-a0d2-465949083f15 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:08.797633 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3847b31f-1633-485a-baf7-ceb9e3abb25a req-c422da30-7bc1-4468-a0d2-465949083f15 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:08.800012 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:08.800456 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:08.801277 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:08.801709 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:08.807771 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-3847b31f-1633-485a-baf7-ceb9e3abb25a req-c422da30-7bc1-4468-a0d2-465949083f15 service nova] Creating event network-vif-deleted:04943923-128c-4497-8f50-577da86b34e2 for instance c407165e-8822-4cbe-a4b4-cdd515e2c048 on hv-cinder-80382 Jun 16 00:49:08.812651 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-3847b31f-1633-485a-baf7-ceb9e3abb25a req-c422da30-7bc1-4468-a0d2-465949083f15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029230 Jun 16 00:49:08.813239 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 541/1084] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:49:08.820213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Getting quotas for project 5e9d772a2cb14bbbaaa2dcaf5d730f6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 00:49:08.824178 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.quota [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Getting quotas for user d0aeb18780734fecbbd6bc8f9202f84d and project 5e9d772a2cb14bbbaaa2dcaf5d730f6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124721) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 00:49:08.885417 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Going to run 1 instances... {{(pid=124721) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 00:49:08.887587 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d1df40e-f104-41ba-8ba6-dec747a489a7',volume_size=None,volume_type=None)] {{(pid=124721) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 00:49:08.944346 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:08.945123 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:08.951292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:08.951750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:08.952804 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:08.953245 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:09.016209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:09.023762 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b7a1a5e0-0939-4a76-843a-15041de72e3b tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1225 microversion: 2.1 time: 0.083677 Jun 16 00:49:09.024380 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 542/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:08 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:49:09.283192 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-241b9d84-6b57-42a2-9f17-57350ef12b61 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980568 Jun 16 00:49:09.283874 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 544/1086] 10.222.0.20 () {60 vars in 1146 bytes} [Thu Jun 16 00:49:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 00:49:09.294423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-c0ce59cc-cc4d-404f-b2e7-3a19333f3649 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:09.295046 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-c0ce59cc-cc4d-404f-b2e7-3a19333f3649 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:09.348948 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-c0ce59cc-cc4d-404f-b2e7-3a19333f3649 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:09.355679 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-c0ce59cc-cc4d-404f-b2e7-3a19333f3649 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1089 microversion: 2.1 time: 0.065246 Jun 16 00:49:09.356240 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 543/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:09 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:10.040303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:10.040947 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:10.048024 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:10.048418 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:10.049321 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:10.049765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:10.081590 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:10.082051 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:10.082506 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lazy-loading 'fault' on Instance uuid c407165e-8822-4cbe-a4b4-cdd515e2c048 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:49:10.125044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517928d85b764c089c6dd5b2d088639c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a122fcfab7f418baf78d7b742fa20db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:10.132249 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4de0c004-f48a-43de-a140-3c884e677511 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 200 len: 1184 microversion: 2.1 time: 0.096418 Jun 16 00:49:10.132854 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 545/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:10 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 1184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:10.372480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-01ac81c6-885c-4b65-b8c0-c736d3066799 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:10.373049 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-01ac81c6-885c-4b65-b8c0-c736d3066799 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:10.426234 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-01ac81c6-885c-4b65-b8c0-c736d3066799 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:10.433044 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-01ac81c6-885c-4b65-b8c0-c736d3066799 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1089 microversion: 2.1 time: 0.064410 Jun 16 00:49:10.433607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 544/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:10 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:11.150176 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:11.150783 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: c407165e-8822-4cbe-a4b4-cdd515e2c048] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:11.157310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.157762 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.158517 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.158954 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.178845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] HTTP exception thrown: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Request method failure captured: Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 HTTP/1.1 Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnxoO9ghD0N90Begoj2wLwpp6Dd8Pb00SM7fZ-mkM_BnRqb5qPuQ6euFtzESujJ6cQBkb1hdmKHsqaY5kDuoIBdM6w8fb6Usg93l3vjUPz2pkBfOubzrcCpXelnvdU1OypkiBpXaNoTlRZQjl17xeO4dkk47QNzOqTnWMRvEHDMo_fw Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:49:11.181532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}] Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 517928d85b764c089c6dd5b2d088639c Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. Jun 16 00:49:11.183158 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'c407165e-8822-4cbe-a4b4-cdd515e2c048'} Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:49:11.184126 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. Jun 16 00:49:11.185779 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.187237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Returning 404 to user: Instance c407165e-8822-4cbe-a4b4-cdd515e2c048 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:49:11.187237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2b472421-7ad1-40cd-91f3-2e097a6d07ce tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048" status: 404 len: 111 microversion: 2.1 time: 0.036769 Jun 16 00:49:11.187237 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 546/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:11 2022] GET /compute/v2.1/servers/c407165e-8822-4cbe-a4b4-cdd515e2c048 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:49:11.449824 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:11.450438 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:11.457318 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.457776 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.458550 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.458992 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.692905 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:11.693496 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:11.699967 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.700419 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.701230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.701858 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.716921 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] HTTP exception thrown: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Request method failure captured: Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: DELETE /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 HTTP/1.1 Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnxoO9ghD0N90Begoj2wLwpp6Dd8Pb00SM7fZ-mkM_BnRqb5qPuQ6euFtzESujJ6cQBkb1hdmKHsqaY5kDuoIBdM6w8fb6Usg93l3vjUPz2pkBfOubzrcCpXelnvdU1OypkiBpXaNoTlRZQjl17xeO4dkk47QNzOqTnWMRvEHDMo_fw Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:49:11.724031 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}] Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 517928d85b764c089c6dd5b2d088639c Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.726009 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'b9cfd9b5-deae-43b6-a743-de414f1ed662'} Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:49:11.730376 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.732183 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.733841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Returning 404 to user: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:49:11.733841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-23b9d407-34e4-41a9-b9a3-f23dd593bcfc tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 404 len: 111 microversion: 2.1 time: 0.036661 Jun 16 00:49:11.733841 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 547/1091] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:49:11 2022] DELETE /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 00:49:11.736479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:11.736479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] [instance: b9cfd9b5-deae-43b6-a743-de414f1ed662] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:11.741556 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.742147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.743005 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:11.743519 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:11.758470 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.wsgi [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] HTTP exception thrown: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Request method failure captured: Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: request: GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 HTTP/1.1 Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept: application/json Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Accept-Encoding: identity Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Connection: close Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Length: 0 Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Content-Type: application/json Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Host: 10.222.0.20 Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Openstack-System-Scope: None Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: User-Agent: python-urllib3/1.26.9 Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Auth-Token: gAAAAABiqnxoO9ghD0N90Begoj2wLwpp6Dd8Pb00SM7fZ-mkM_BnRqb5qPuQ6euFtzESujJ6cQBkb1hdmKHsqaY5kDuoIBdM6w8fb6Usg93l3vjUPz2pkBfOubzrcCpXelnvdU1OypkiBpXaNoTlRZQjl17xeO4dkk47QNzOqTnWMRvEHDMo_fw Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Id: None Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Domain-Name: None Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Identity-Status: Confirmed Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Is-Admin-Project: True Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Id: default Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Domain-Name: Default Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Project-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Role: reader,member Jun 16 00:49:11.760136 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Roles: reader,member Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a122fcfab7f418baf78d7b742fa20db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a122fcfab7f418baf78d7b742fa20db"}]}] Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Id: 3a122fcfab7f418baf78d7b742fa20db Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-Tenant-Name: tempest-TestVolumeBootPattern-1970093983 Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Id: default Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Domain-Name: Default Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Id: 517928d85b764c089c6dd5b2d088639c Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: X-User-Name: tempest-TestVolumeBootPattern-1970093983-project Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: method: > Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: exception: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.761800 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: action_args: {'id': 'b9cfd9b5-deae-43b6-a743-de414f1ed662'} Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:49:11.762737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. Jun 16 00:49:11.767845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: ERROR nova.api.openstack.wsgi Jun 16 00:49:11.770093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Returning 404 to user: Instance b9cfd9b5-deae-43b6-a743-de414f1ed662 could not be found. {{(pid=124721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:49:11.770093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0a76a7dc-d3a6-4226-9493-3f9b8b15f149 tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662" status: 404 len: 111 microversion: 2.1 time: 0.032303 Jun 16 00:49:11.770093 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 548/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:11 2022] GET /compute/v2.1/servers/b9cfd9b5-deae-43b6-a743-de414f1ed662 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:49:11.808095 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:11.816263 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-4a646e9d-49ad-43fc-b8cc-8e674d2b1612 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1195 microversion: 2.1 time: 0.369914 Jun 16 00:49:11.820507 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 545/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:11 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1195 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:12.835831 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:12.837117 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:12.845273 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:12.846037 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:12.847840 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:12.848474 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:13.004824 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:13.012414 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-f1319afe-1086-4cb0-8149-452ab3ddeea8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1273 microversion: 2.1 time: 0.181189 Jun 16 00:49:13.013008 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 549/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:12 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:13.322072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-263cd1f3-11cc-4759-a673-86d32f3c270e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] Calling method '.version_select at 0x7f2a7b3cc5e0>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:13.453315 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-263cd1f3-11cc-4759-a673-86d32f3c270e tempest-TestVolumeBootPattern-1970093983 tempest-TestVolumeBootPattern-1970093983-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530055099" status: 202 len: 0 microversion: 2.1 time: 0.135059 Jun 16 00:49:13.453832 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 546/1095] 10.222.0.20 () {58 vars in 1259 bytes} [Thu Jun 16 00:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-530055099 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:49:13.526813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-594e9572-d680-4df6-9393-65aa55166e95 req-bb52c204-bd3c-49bb-ba77-887dc94e78b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:13.536973 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-594e9572-d680-4df6-9393-65aa55166e95 req-bb52c204-bd3c-49bb-ba77-887dc94e78b7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:13.537359 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-594e9572-d680-4df6-9393-65aa55166e95 req-bb52c204-bd3c-49bb-ba77-887dc94e78b7 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:13.559682 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-594e9572-d680-4df6-9393-65aa55166e95 req-bb52c204-bd3c-49bb-ba77-887dc94e78b7 service nova] Creating event network-changed:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:49:13.566391 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-594e9572-d680-4df6-9393-65aa55166e95 req-bb52c204-bd3c-49bb-ba77-887dc94e78b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042146 Jun 16 00:49:13.566991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 550/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:49:14.030915 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:14.031876 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:14.038526 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:14.039042 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:14.040037 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:14.040709 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:14.235083 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:14.243670 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-32f4a096-89ea-41f7-86d8-ceb2fd959b59 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.216588 Jun 16 00:49:14.244705 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 547/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:14 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:15.261658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:15.262352 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:15.269232 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:15.269926 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:15.270869 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:15.271310 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:15.476347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:15.484658 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-35cf84ed-b448-4c38-bb61-e5efb47b1e76 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.227118 Jun 16 00:49:15.485231 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 551/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:15 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:16.501084 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:16.501790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:16.508421 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:16.508913 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:16.509685 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:16.510132 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:16.675669 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:16.685145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b75d7802-8437-477b-aa45-59c4ab8eec16 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.187904 Jun 16 00:49:16.685710 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 548/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:16 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:17.702377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:17.702984 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:17.709951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:17.710395 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:17.711152 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:17.711582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:17.842760 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:17.851079 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-aab760b1-8a46-41e9-a4df-ec7f59b12ca6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.152816 Jun 16 00:49:17.851835 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 552/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:17 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:18.867815 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:18.868377 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:18.874838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:18.875296 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:18.876282 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:18.876755 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:19.082074 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:19.089722 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-70f5f312-8108-4e0b-a9ea-fd64b840cb38 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.225795 Jun 16 00:49:19.090284 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 549/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:18 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:20.106134 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:20.107403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:20.114202 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=2 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:20.115067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell0:SELECT=6 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:20.116991 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:20.117447 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:20.118213 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:20.119493 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:20.263977 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:20.274669 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-95666adb-0f31-4781-9c0a-cd9cc09a9f72 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.172243 Jun 16 00:49:20.284019 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 553/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:20 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:21.291622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:21.292355 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:21.294343 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell0:SELECT=4 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:21.295001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:21.299697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:21.300617 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:21.301376 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:21.301806 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:21.305900 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:21.453594 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:21.461012 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f5561213-cc23-4813-8e3d-f3a17f0c55b5 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.173555 Jun 16 00:49:21.461566 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 550/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:21 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:22.478230 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:22.479000 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:22.485623 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:22.486075 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:22.486845 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:22.487847 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:22.624208 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:22.632550 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-20cbbb85-30e5-48a9-a030-f8b4955defe0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.158124 Jun 16 00:49:22.633122 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 554/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:22 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:23.295343 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-f26afa71-d7d3-4fe4-972b-a9b1957d6303 req-b5dd349d-09f4-475d-acef-8b674879c6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "name": "network-vif-plugged", "status": "completed", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:23.305308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-f26afa71-d7d3-4fe4-972b-a9b1957d6303 req-b5dd349d-09f4-475d-acef-8b674879c6de service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:23.305750 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-f26afa71-d7d3-4fe4-972b-a9b1957d6303 req-b5dd349d-09f4-475d-acef-8b674879c6de service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:23.316368 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.compute.server_external_events [req-f26afa71-d7d3-4fe4-972b-a9b1957d6303 req-b5dd349d-09f4-475d-acef-8b674879c6de service nova] Creating event network-vif-plugged:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:49:23.321469 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-f26afa71-d7d3-4fe4-972b-a9b1957d6303 req-b5dd349d-09f4-475d-acef-8b674879c6de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030458 Jun 16 00:49:23.322035 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 551/1105] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:49:23.649720 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:23.650461 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:23.656915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:23.657427 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:23.658236 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:23.658679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:23.794649 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:23.802420 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-dfeefc3b-7f87-4336-8973-535da2eeb771 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.156571 Jun 16 00:49:23.802972 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 555/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:23 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:24.819495 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:24.820187 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:24.828602 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:24.829048 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:24.829802 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:24.830233 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:24.961373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:24.968857 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b4386ee8-37a5-4ab8-a4d5-a3b9ca3e295d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1261 microversion: 2.1 time: 0.153600 Jun 16 00:49:24.969423 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 552/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:24 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:25.986259 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:25.986816 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:25.993756 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:25.994609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:25.995369 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:25.995801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:26.122385 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:26.124573 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:26.130877 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-0274b3cb-b700-4cc6-888e-a158b2e5552d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1446 microversion: 2.1 time: 0.148571 Jun 16 00:49:26.131467 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 556/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:25 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:26.147508 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:49:26.155257 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:49:26.156108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:26.156599 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:26.157361 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:26.157798 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:26.290664 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:49:26.298163 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2c81aa44-a735-4b42-9db4-ea7764fd4239 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1446 microversion: 2.1 time: 0.155031 Jun 16 00:49:26.298721 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 553/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:49:26 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1446 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:49:28.329571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-57600955-0643-4b02-8770-984a81627b71 req-6b2e71cc-5967-463a-9c7b-9fe95fc97af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:49:28.333532 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:49:28.339347 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-57600955-0643-4b02-8770-984a81627b71 req-6b2e71cc-5967-463a-9c7b-9fe95fc97af4 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:49:28.339797 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-57600955-0643-4b02-8770-984a81627b71 req-6b2e71cc-5967-463a-9c7b-9fe95fc97af4 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:49:28.351292 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-57600955-0643-4b02-8770-984a81627b71 req-6b2e71cc-5967-463a-9c7b-9fe95fc97af4 service nova] Creating event network-changed:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:49:28.356421 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-57600955-0643-4b02-8770-984a81627b71 req-6b2e71cc-5967-463a-9c7b-9fe95fc97af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031077 Jun 16 00:49:28.357199 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 557/1110] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:49:55.970774 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:49:55.971357 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:49:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:51:22.474660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=7 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:22.475358 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=19 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:51:22.479937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:51:22.480460 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:22.486162 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:22.486607 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:22.487357 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:22.487793 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:22.509969 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.objects.instance [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lazy-loading 'flavor' on Instance uuid 3be606de-606d-4ed1-9de7-778277d2d4b1 {{(pid=124722) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:51:22.764203 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-ca523aed-7c35-4c61-9bb3-e3fa8533dfa8 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "POST /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1/action" status: 202 len: 0 microversion: 2.1 time: 0.291094 Jun 16 00:51:22.764809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 554/1111] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:51:22 2022] POST /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:51:22.775067 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:22.779382 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:22.783481 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:22.783933 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:22.784725 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:22.785162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:23.029818 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:23.037287 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a6ead98c-7072-44e6-a20f-993995a21727 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.268169 Jun 16 00:51:23.037873 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 558/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:22 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:24.056379 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:24.057104 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:24.063271 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:24.063714 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:24.064464 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:24.064926 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:24.503221 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:24.511509 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0e96bcb9-32c1-4fb9-9333-fa816e7bf8d6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.459929 Jun 16 00:51:24.512108 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 555/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:24 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:25.528704 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:25.529314 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:25.535931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:25.536384 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:25.537162 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:25.537592 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:25.671849 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:25.680846 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d7a1cf1e-3b72-4e63-83ce-b3f85a4f8f1b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.155584 Jun 16 00:51:25.682339 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 559/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:25 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:26.699189 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:26.699732 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:26.706372 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:26.713430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:26.713430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:26.713430 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:26.840254 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:26.847660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-0da7cb1c-ab50-4fbb-83d9-473e265be929 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.153120 Jun 16 00:51:26.848209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 556/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:26 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:27.864587 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:27.865115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:27.871695 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:27.872145 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:27.872981 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:27.873411 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:28.002931 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:28.011115 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-2b8586ed-85c1-46a3-825a-19d9095a6159 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.150573 Jun 16 00:51:28.011672 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 560/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:27 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:29.028556 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:29.029164 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:29.035560 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:29.036005 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:29.036773 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:29.037209 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:29.163173 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:29.170594 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6a08efca-38dd-4fd9-8616-5f18f2f1107a tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.146471 Jun 16 00:51:29.171147 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 557/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:29 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:30.187578 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:30.188185 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:30.194377 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:30.194823 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:30.195582 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:30.196040 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:30.324094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:30.331842 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-18ef1da2-15ae-4a5f-a39c-400f62a9cf04 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.148119 Jun 16 00:51:30.332404 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 561/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:30 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:31.203801 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:51:31.204737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:51:31.348243 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:31.348884 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:31.355440 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:31.355901 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:31.356711 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:31.357155 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:31.482708 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:31.490146 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3e16d5f4-2fa1-482a-8e3a-cb574c5c64ec tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.145782 Jun 16 00:51:31.490703 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 558/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:31 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:32.507501 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:32.508106 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:32.515189 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:32.515737 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:32.516492 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:32.516949 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:32.644425 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:32.651951 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-bf152a66-eba3-4813-9be7-78306a47607d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.148283 Jun 16 00:51:32.652513 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 562/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:32 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:33.668612 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:33.669227 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:33.675663 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:33.676110 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:33.676893 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:33.677325 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:33.813897 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:33.821492 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9299f4ee-4f30-407a-b51b-95b492a3b633 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.156718 Jun 16 00:51:33.822034 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 559/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:33 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:34.839322 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:34.839915 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:34.846564 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:34.846952 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:34.847759 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:34.848198 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:34.982016 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:34.989510 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c4df792e-3925-44ed-9475-697ccead2061 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.154001 Jun 16 00:51:34.990072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 563/1122] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:34 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:36.006477 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:36.007057 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:36.014214 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.014660 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.015418 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.015849 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.146011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:36.153486 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-06a359dc-b8f9-448e-bf0d-56a8228afed7 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1572 microversion: 2.1 time: 0.150822 Jun 16 00:51:36.154036 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 560/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:36 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:36.169358 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:51:36.171147 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:36.176451 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.176936 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.177719 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.178179 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.414942 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-4b92f94e-88b0-4b91-be3f-3a9351c802ad tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "POST /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1/action" status: 202 len: 0 microversion: 2.1 time: 0.249314 Jun 16 00:51:36.415515 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 564/1124] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Jun 16 00:51:36 2022] POST /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:51:36.424140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:36.424895 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:36.430885 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.431903 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.432738 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:36.433391 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:36.572076 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:36.582880 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-f49102cd-1988-4c91-a8d7-fe8930ad4773 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1580 microversion: 2.1 time: 0.162666 Jun 16 00:51:36.583455 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 561/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:36 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:37.601499 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:37.602508 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:37.608654 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:37.609097 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:37.609851 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:37.610284 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:37.745311 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:37.753730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-35be861a-cf33-4e10-818c-53f25bd9a03d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1522 microversion: 2.1 time: 0.156904 Jun 16 00:51:37.754301 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 565/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:37 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:37.797836 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [req-3ec01518-868b-452f-a0d2-07c89b7d312e req-8289ff95-4acc-4c6d-ae1b-531c3987d1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "name": "network-vif-unplugged", "status": "completed", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:51:37.806822 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3ec01518-868b-452f-a0d2-07c89b7d312e req-8289ff95-4acc-4c6d-ae1b-531c3987d1c5 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:37.807268 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [req-3ec01518-868b-452f-a0d2-07c89b7d312e req-8289ff95-4acc-4c6d-ae1b-531c3987d1c5 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:37.818182 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.compute.server_external_events [req-3ec01518-868b-452f-a0d2-07c89b7d312e req-8289ff95-4acc-4c6d-ae1b-531c3987d1c5 service nova] Unable to find a host for instance 3be606de-606d-4ed1-9de7-778277d2d4b1. Dropping event network-vif-unplugged {{(pid=124722) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 00:51:37.819808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [req-3ec01518-868b-452f-a0d2-07c89b7d312e req-8289ff95-4acc-4c6d-ae1b-531c3987d1c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025103 Jun 16 00:51:37.819808 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 562/1127] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 00:51:38.771764 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:38.772388 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:38.778962 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:38.779443 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:38.780209 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:38.780666 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:38.915160 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:38.923203 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-d8004ad9-1a03-4fc3-830b-90d569ce6de0 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1522 microversion: 2.1 time: 0.156037 Jun 16 00:51:38.923765 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 566/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:38 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:39.940752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:39.941328 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:39.947692 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:39.948143 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:39.948937 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:39.949358 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:40.086752 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:40.094943 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-71f713e9-9fdc-446b-b57d-35aa2cb89c6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.158219 Jun 16 00:51:40.095496 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 563/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:39 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:40.315467 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:51:40.316003 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:51:41.111710 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:41.112309 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:41.119388 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:41.119833 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:41.120609 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:41.121041 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:41.254768 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:41.262116 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-88a8b56f-8b74-4a77-9b2f-c6e43b9b5ffc tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.154290 Jun 16 00:51:41.262671 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 567/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:41 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:42.279657 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:42.280276 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:42.287140 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:42.287584 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:42.288342 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:42.288798 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:42.419828 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:42.427554 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-5f6cccf0-e4a6-4780-bd45-bac9d3b93894 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.152241 Jun 16 00:51:42.428121 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 564/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:42 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:43.444362 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:43.445027 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:43.451594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:43.452044 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:43.452837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:43.453272 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:43.579799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:43.587370 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-3d257fbf-da85-47bc-b550-67ac0bb645ea tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.146860 Jun 16 00:51:43.588453 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 568/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:43 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:44.605353 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:44.605986 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:44.612580 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:44.613032 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:44.613777 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:44.614206 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:44.742538 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:44.750498 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-e611c243-e590-4888-a8af-73830166e8ba tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.149603 Jun 16 00:51:44.751047 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 565/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:44 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:45.767571 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:45.768175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:45.774839 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:45.775281 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:45.776035 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:45.776467 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:45.909625 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:45.917121 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-c6f9f3f0-d213-42d0-bf17-a36cfde5dc80 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.153499 Jun 16 00:51:45.917679 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 569/1134] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:45 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:46.934622 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:46.935171 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:46.941682 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:46.942109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:46.942861 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:46.943292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:47.070871 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:47.078854 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-d7835231-7c1f-4cbe-9e09-f62a38735a48 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.148839 Jun 16 00:51:47.079665 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 566/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:46 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:48.095463 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:48.096072 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:48.102569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:48.103022 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:48.103799 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:48.104812 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:48.233727 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:48.241207 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-921b433c-6f79-4680-bb6a-954619d981ae tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.149708 Jun 16 00:51:48.241770 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 570/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:48 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:49.257780 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:49.258419 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:49.264882 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:49.265337 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:49.266093 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:49.266525 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:49.394167 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:49.401809 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-9b1d9982-ccd0-4306-a85b-1eca8dab7b3d tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.147897 Jun 16 00:51:49.402373 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 567/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:49 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:49.888546 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-51df498b-6afd-4b17-b916-764a6d4af369 req-fcff4e8d-3a19-42e8-a5b2-58d6d1e36a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "name": "network-vif-plugged", "status": "completed", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:51:49.904274 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-51df498b-6afd-4b17-b916-764a6d4af369 req-fcff4e8d-3a19-42e8-a5b2-58d6d1e36a28 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:49.905561 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-51df498b-6afd-4b17-b916-764a6d4af369 req-fcff4e8d-3a19-42e8-a5b2-58d6d1e36a28 service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:49.915961 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-51df498b-6afd-4b17-b916-764a6d4af369 req-fcff4e8d-3a19-42e8-a5b2-58d6d1e36a28 service nova] Creating event network-vif-plugged:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:51:49.921118 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-51df498b-6afd-4b17-b916-764a6d4af369 req-fcff4e8d-3a19-42e8-a5b2-58d6d1e36a28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Jun 16 00:51:49.921662 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 571/1138] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 00:51:50.418161 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:50.418719 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:50.424838 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:50.425292 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:50.426050 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:50.426488 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:50.555145 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:50.563447 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-2c082e0c-a289-48fe-b76e-6e6dd79d720b tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1578 microversion: 2.1 time: 0.149220 Jun 16 00:51:50.564011 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 568/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:50 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:51:51.581994 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:51:51.582691 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:51:51.589566 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:51.590015 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:51.590786 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:51:51.591221 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:51:51.727449 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:51:51.734928 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-16c24fce-4334-492a-9995-14cf6d6479f6 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1565 microversion: 2.1 time: 0.158024 Jun 16 00:51:51.735479 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 572/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:51:51 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:53:04.750280 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_api:SELECT=30 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:53:04.763556 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG dbcounter [-] [124722] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:53:04.764279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_api:SELECT=33 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:53:04.764279 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG dbcounter [-] [124721] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:53:04.764769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:04.764769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:04.764769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:04.764769 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:04.765109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:04.765109 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:04.791748 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Going to try to terminate instance {{(pid=124722) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 00:53:04.821908 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-8eba1a15-f999-4859-ab3b-af4610fbabe0 req-d17a1056-d0c2-42a7-b41f-cb30572c7c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:53:04.831193 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-8eba1a15-f999-4859-ab3b-af4610fbabe0 req-d17a1056-d0c2-42a7-b41f-cb30572c7c1f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:04.831636 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-8eba1a15-f999-4859-ab3b-af4610fbabe0 req-d17a1056-d0c2-42a7-b41f-cb30572c7c1f service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:04.849094 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-8eba1a15-f999-4859-ab3b-af4610fbabe0 req-d17a1056-d0c2-42a7-b41f-cb30572c7c1f service nova] Creating event network-changed:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:53:04.852863 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-8eba1a15-f999-4859-ab3b-af4610fbabe0 req-d17a1056-d0c2-42a7-b41f-cb30572c7c1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102450 Jun 16 00:53:04.853458 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 573/1141] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:53:05.139530 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-3a1f3f53-84fb-48a0-ae3a-84d574e2ae6e tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 204 len: 0 microversion: 2.1 time: 0.390952 Jun 16 00:53:05.140183 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 569/1142] 10.222.0.20 () {58 vars in 1238 bytes} [Thu Jun 16 00:53:04 2022] DELETE /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 00:53:05.150042 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:05.150738 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:05.157956 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:05.158403 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:05.159223 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:05.159650 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:05.289730 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:53:05.297304 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-26049ea0-c419-4821-abde-740dc80665d2 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.151960 Jun 16 00:53:05.298113 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 574/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:53:05 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:53:06.315416 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:06.316359 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:06.324291 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:06.324790 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:06.325691 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:06.326306 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:06.506558 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:53:06.515264 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-6e764003-1282-4fdd-ac01-a09e37fa8b01 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1571 microversion: 2.1 time: 0.204506 Jun 16 00:53:06.515830 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 570/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:53:06 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1571 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:53:07.357830 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [req-001b6d7d-77a3-4019-80d3-f49ce5a1783d req-4e5c549b-2fce-4952-859f-4eb86075f75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be606de-606d-4ed1-9de7-778277d2d4b1", "name": "network-vif-deleted", "tag": "1c8e4700-5ce1-4ab4-a357-9d3dde87e98b"}]} {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 00:53:07.366430 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-001b6d7d-77a3-4019-80d3-f49ce5a1783d req-4e5c549b-2fce-4952-859f-4eb86075f75e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:07.366867 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [req-001b6d7d-77a3-4019-80d3-f49ce5a1783d req-4e5c549b-2fce-4952-859f-4eb86075f75e service nova] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:07.377829 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.compute.server_external_events [req-001b6d7d-77a3-4019-80d3-f49ce5a1783d req-4e5c549b-2fce-4952-859f-4eb86075f75e service nova] Creating event network-vif-deleted:1c8e4700-5ce1-4ab4-a357-9d3dde87e98b for instance 3be606de-606d-4ed1-9de7-778277d2d4b1 on hv-cinder-80382 Jun 16 00:53:07.382742 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [req-001b6d7d-77a3-4019-80d3-f49ce5a1783d req-4e5c549b-2fce-4952-859f-4eb86075f75e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081941 Jun 16 00:53:07.383303 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 575/1145] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Jun 16 00:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 00:53:07.534137 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:07.534707 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:07.541667 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:07.542112 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:07.542872 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:07.543308 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:07.614300 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.policy [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124722) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:53:07.622006 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-b2e251b8-6de8-4289-ba11-294438461d6c tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1220 microversion: 2.1 time: 0.092843 Jun 16 00:53:07.622581 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 571/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:53:07 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 00:53:08.639507 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:08.640196 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.compute.api [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124721) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:08.646389 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:08.646836 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:08.647594 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:08.648028 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:08.678459 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:08.678900 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG oslo_concurrency.lockutils [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:08.679340 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.objects.instance [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lazy-loading 'fault' on Instance uuid 3be606de-606d-4ed1-9de7-778277d2d4b1 {{(pid=124721) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 00:53:08.719686 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.policy [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0aeb18780734fecbbd6bc8f9202f84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e9d772a2cb14bbbaaa2dcaf5d730f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124721) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 00:53:08.727090 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-a988c203-8eef-445f-8f04-c59a1e2e90cf tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 200 len: 1225 microversion: 2.1 time: 0.092300 Jun 16 00:53:08.727837 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 576/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:53:08 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 00:53:09.744624 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '>' {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:09.745238 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.compute.api [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] [instance: 3be606de-606d-4ed1-9de7-778277d2d4b1] Fetching instance by UUID {{(pid=124722) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 00:53:09.751737 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:09.752195 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:09.752997 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 00:53:09.753442 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG oslo_concurrency.lockutils [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Lock "05a3bc2a-bfb9-434c-ae77-5f7d553f0730" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 00:53:09.766593 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.wsgi [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] HTTP exception thrown: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Request method failure captured: Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: request: GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 HTTP/1.1 Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept: application/json Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Accept-Encoding: identity Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Connection: close Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Length: 0 Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Content-Type: application/json Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Host: 10.222.0.20 Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Openstack-System-Scope: None Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: User-Agent: python-urllib3/1.26.9 Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Auth-Token: gAAAAABiqn3rwGNX1Tz-K5lKlHnFAJl4nkfC2B3h_8WHQj0WLysag2wPlW_U4eDUTd1HFNPspClPdKO6RsrdJeve73hnhZYmuUdtgouWvUv6fZHsE-PQ7JGOTYL11WDB_4K8l5E_2AS1EaXv6iVjiPrcKr32lPI-TfLHF4LsdzmDALbWOnUaUBE Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Id: None Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Domain-Name: None Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Identity-Status: Confirmed Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Is-Admin-Project: True Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Id: default Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Domain-Name: Default Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Id: 5e9d772a2cb14bbbaaa2dcaf5d730f6e Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Project-Name: tempest-TestShelveInstance-426082959 Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Role: reader,member Jun 16 00:53:09.768286 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Roles: reader,member Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e9d772a2cb14bbbaaa2dcaf5d730f6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5e9d772a2cb14bbbaaa2dcaf5d730f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5e9d772a2cb14bbbaaa2dcaf5d730f6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5e9d772a2cb14bbbaaa2dcaf5d730f6e"}]}] Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant: tempest-TestShelveInstance-426082959 Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Id: 5e9d772a2cb14bbbaaa2dcaf5d730f6e Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-Tenant-Name: tempest-TestShelveInstance-426082959 Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User: tempest-TestShelveInstance-426082959-project Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Id: default Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Domain-Name: Default Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Id: d0aeb18780734fecbbd6bc8f9202f84d Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: X-User-Name: tempest-TestShelveInstance-426082959-project Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: method: > Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: exception: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. Jun 16 00:53:09.770158 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: action_args: {'id': '3be606de-606d-4ed1-9de7-778277d2d4b1'} Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: {{(pid=124722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 00:53:09.771241 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. Jun 16 00:53:09.772697 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: ERROR nova.api.openstack.wsgi Jun 16 00:53:09.773974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: DEBUG nova.api.openstack.wsgi [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Returning 404 to user: Instance 3be606de-606d-4ed1-9de7-778277d2d4b1 could not be found. {{(pid=124722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 00:53:09.773974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO nova.api.openstack.requestlog [None req-a6903a16-a59a-472c-8874-64ce118392aa tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1" status: 404 len: 111 microversion: 2.1 time: 0.029112 Jun 16 00:53:09.773974 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: [pid: 124722|app: 0|req: 572/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Thu Jun 16 00:53:09 2022] GET /compute/v2.1/servers/3be606de-606d-4ed1-9de7-778277d2d4b1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 00:53:09.988639 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: DEBUG nova.api.openstack.wsgi [None req-76549e85-6f91-4f01-ab93-cdff8ef82475 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] Calling method '.version_select at 0x7f2a7b32e310>' {{(pid=124721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 00:53:10.075668 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO nova.api.openstack.requestlog [None req-76549e85-6f91-4f01-ab93-cdff8ef82475 tempest-TestShelveInstance-426082959 tempest-TestShelveInstance-426082959-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1125781319" status: 202 len: 0 microversion: 2.1 time: 0.090843 Jun 16 00:53:10.076244 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: [pid: 124721|app: 0|req: 577/1149] 10.222.0.20 () {58 vars in 1253 bytes} [Thu Jun 16 00:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1125781319 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 00:53:15.978797 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:53:15.979426 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:53:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:54:46.589914 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:54:46.590623 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:54:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:54:51.212813 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:54:51.213395 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:54:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:55:07.935573 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:55:07.936072 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:56:35.988729 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:56:35.989480 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:56:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:58:06.599416 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:58:06.600001 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:58:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:58:11.220899 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:58:11.221477 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:58:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:58:20.326904 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:58:20.327569 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:58:26.713540 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:58:26.714175 dv-cinder-803823-11-iscsi devstack@n-api.service[124721]: Thu Jun 16 00:58:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 00:58:27.943570 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 00:58:27.944142 dv-cinder-803823-11-iscsi devstack@n-api.service[124722]: Thu Jun 16 00:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!